Here, the "parallel corpus" refers to a series of speech-gaze pairs, each of them consisting of a list of words from the spoken references in the user utterances and a list of objects that are fixated upon within the same time window.
we first transcribed the user speech into scripts by automatic speech recognition software and then refined them manually.