The objective is to learn the joint-association between the multiple modalities & utterances, and to emphasize on the contributing features by putting more attention to these.
we employ bi-modal attention framework, where an attention function is applied to the representations of pairwise modalities i.e.