Finally, we study the importance of individual crossmodal transformers according to the target modalities (i.e., using Table 4, we find crossmodal attention modules consistently improve over the late-and earlyfusion transformer models in most metrics on unaligned CMU-MOSEI.
among the three crossmodal transformers, the one where language(L) is the target modality works best.