When we use the most relevant data chunk (about 20 million words) to re-rank the N -best list, 36 chunks of data will be used at least once for 919 different sentences, which accounts for about 720 million words in total.
besides comparing the distributed language model re-ranked translations with the model-best translations, we also want to compare the distributed LM with the the standard 3-gram and 4-gram language models on the N -best list re-ranking task.