For each sentence beam, we try M sentences or captions and keep the one achieving best word-level scores.
we propose three multi-modal attention mechanisms which take images and captions into consideration.