The multi-modal hierarchical beam search algorithm comprises K-best word-level beam search and Nbest sentence-caption-level beam search.
we use the corresponding captions instead of images in beam search algorithm for the attTI mechanism which attends images.