Previous work proposed an end-to-end time-aware attention network to leverage both contextual and temporal information for spoken language understanding and achieved the significant improvement, showing that the temporal attention can guide the attention effectively .
namely, in dialogue contexts, the recent utterances contain most information related to the current utterance, which is aligned with our intuition.