(3) Although the size of the parts-of-speech is the   Table 4), they have the largest impact on our factored RNNLM.
this paper uses RNNLM as a baseline and improves it by incorporating additional information other than surface words, such as morphological or syntactic features.