We rely on the CNN framework (Socher et al., 2014;Simonyan and Zisserman, 2015) to solve semantic classification and disambiguation tasks in NLP with the help of supervision signals from visual feedback.
we consider image captioning as a different task than caption translation since it is not given the information of the source language string.