Therefore, the result that audio-only MDRM performs better than textonly MDRM (1.412 vs. 1.431) may need careful interpretation as we have to stop audio-only model training early to prevent overfitting.
they present a bidirectional contextual LStM (bc-LStM) framework for fusing multimodal features including audio, video and text.