3.1, we further expect the RNN Encoder-Decoder which was trained without any frequency information to score the phrase pairs based rather on the linguistic regularities than on the statistics of their occurrences in the corpus.
we focus on those pairs whose source phrase is long (more than 3 words per source phrase) and the probability of words not in the shortlist is always overestimated.