However, when one is instructed to interpret a multimodal message, like Figures 1 and 2, not all information in the scheme of Figure 3 is available.
the translation functions PL-G and PG-L of the graphical and linguistic individual constants mentioned in the texts and the pictures of the multimodal messages are not known, and the crucial inference of the interpretation process has as its goal to find out the definition of these functions (i.e., to establish the relations between names of L and G).