Here, we do not address the acoustic model of speech recognition, but rather incorporate the salience distribution for language modeling.
our focus is on investigating the effect of incorporating additional information from other modalities (e.g., gesture) with traditional language models.