Prior work demonstrated the power of pre-training with image classification at scale (Sun et al., 2017;Mahajan et al., 2018;Wu et al., 2019).
we consider downstream vision and language tasks (image captioning and visual question answering), in contrast to less complex vision-only tasks explored in such work: object detection and in some cases semantic segmentation and human pose estimation.