As one important finding, we observe that the gains in perplexity using our fine-tuning AP method extend also to these larger evaluation datasets.
we find improvements of the same magnitude as in the PTB-sized data sets over the strongest baseline model (Char-CNN-LSTM) for all MWC languages.