In sum, we can conclude that the higher correlation with human judgments indicates that integrating textual and perceptual modalities jointly is preferable to concatenation.
note that all models in Table 2 fall short of the human upper bound which we measured by calculating the reliability of Nelson et al.