This is consistent with our motivation that open-domain short-text conversation covers a wide range of topics and areas, and the top frequent words are not enough to capture the content of most training pairs.
many enhanced encoder-decoder approaches have been proposed to improve the quality of generated responses.