This procedure is particularly harmful for DE-EN BLEU and WBLEU scores (for BI-RNN, average ∆ρ=0.11), which is the most well represented language pair across WMT years.
it may be the case that the random ALL selection contains more useful data.