Several pre-trained visually grounded models have been proposed recently, and they are conceptually similar yet vary in design details, making evaluating them complicated and difficult.
for simplicity, we propose a simple and performant baseline, VisualBERT (see Figure 2), and base our analysis on this model.