The syntactic and semantic structures of the three languages permit expression and interpretation of information in each of the modalities, and the ability to systematically find correlated expressions in different modalities with the same semantic values.
it is possible to state formally what it means to resolve a multimodal reference: according to this theory, to resolve a multimodal reference is to find the semantic value of an expression using either the information expressed in the modality or information expressed through other modalities with the help of the translation functions.