As expected, GLI outperforms both LI and CM.
whereas LI and CM essentially converge in test set perplexity with only 100 words of devel- opment data, it takes about 500 words before GLI converges due to the increased number of parameters.