On the other hand, in our "neural language model" training, losses are calculated for each input character, and these losses are much more than those of "target task" training.
"neural language model" training can help the model to learn more precisely for each input character.