However, when we share the latent representations for the last few layers (joint-NN), we see that results improve substantially.
ly, textual label performance is on par with baseline, suggesting the addition of image label data helps learn the latent representations of textual labels.