Warm-starting each of the branches in the dual-encoder leads to substantial improvements Image to Caption Model R@1 R@5 R@10 R@50 R@100 R@1 R@5 R@10 R@50 R@100  over the baseline, and combining both branches leads to the best overall performance.
we improve R@10 for caption-toimage from the .296 obtained by Chrupała (2019) by 20% absolute to .495, without using multitask training or pretraining g vis on ImageNet (Deng et al., 2009).