We would like to adopt a similar training procedure as BERT but VisualBERT must learn to accommodate both language and visual input.
we reach to a resource of paired data: COCO (Chen et al., 2015) that contains images each paired with 5 independent captions.