To make the system learn this difference, we proposed a modality attention fusion that puts an attention Figure 4: Modality Fusion layer over the extracted modality-specific features, helping the system focus on the informative modality.
it is hard for a computer to precisely interpret human meaning because: 1.