Speech and gesture information within the same semantic category can then be fused to form a complete multimodal meaning, where previous methods on representing multimodal semantic (Bergmann and Kopp, 2008;Bergmann et al., 2013a;Lascarides and Stone, 2009; Giorgolo, 2010) can be applied.
this enables HCIs to construct and represent multimodal semantics of natural communications involving iconic gestures.