Our focus instead is to show that with the addition of language to ground the noisy initial visual detections, we are able to improve the quality of the generated sentence as a faithful description of the image.
we show that it is possible to avoid predicting actions directly from images -which is still unreliable -and to use the corpus instead to guide our predictions.