The gold annotations are available for every 0.2 seconds in each video (Nicolle et al., 2012).
to align with our problem statement, we approximate the utterance-level annotation as the mean of the continuous values within the spoken utterance.