Since available video/text pairs are limited in size, the direct application of end-to-end deep learning is not feasible.
we propose to train Faster R-CNN network for object recognition and LSTM for text generation and combine them at run time.