We ascribe this result to the information bias of sentence embeddings generated by GRU, that is, GRU tends to pay more attention to the words in the end of a sentence.
for the task discussed by this paper, complete semantics provide more help to context-aware candidate selection as discussed in Section 2.1.