Thus, these knowledge was integrated in the representation level, and then the joint probabilities of words and corresponding SuperARVs were estimated.
in the class-based language models, words are taken as the model units, while other units smaller or larger than words are unfeasible for modeling simultaneously, such as the Chinese characters for Chinese names.