Suppose that the num-ber of input modalities is n, I l denotes the features of l-th modality, the space of I l is R d l ×t l where t l denotes the temporal length and d l denotes the feature dimensions.
when we combine them, the performances are significantly improved on metrics, especially ROUGE and CIDEr.