The ensemble technique provided further improvement, as described in pre- 8 We exclude models that use the statistics of the test data (Grave et al., 2017;Krause et al., 2017) from these tables because we regard neural language models as the basis of NLP applications and consider it unreasonable to know correct outputs during applications, e.g., machine translation.
we focus on neural language models as the foundation of applications although we can combine the method using the statistics of test data with our AWD-LSTM-DOC.