This must have been due to the different natures of the training and test data.
the texts of the Asahi newspaper articles and TD2-{M,F}-J are controlled under a similar standard (in terms of vocabulary, syntax, and so forth), which would account for the difference from the case in English.