Although "Hop1 Selector" can choose proper context utterances that are related to the last dialogue session, we find that there are many samples whose last utterance contains very little information (such as "good", "ok"), which will cause the selector lose too much useful context information.
we combine it with u i,L−1 , u i,L−2 , ..., u i,L−k by mean pooling.