Since we did not have such a corpus at our disposal we decided to follow (Rajendran et al., 2015) and use a pseudo parallel corpus between English-French.
we take the English captions from the MSCOCO data and translate them to French using the publicly available translation system provided by IBM (http://www.ibm.com/ smarterplanet/us/en/ibmwatson).