In this section, we assess the performance of language models on varying quantities of data, across a number 1,000 10,000 100,000 200 of different source-target language pairs.
we use CLWEs to initialize the first layer in an LSTM recurrent neural network language model and assess how this affects language model performance.