All these research have showed us the very good capability of the neural language model in learning word representation.
as input, character features (unigram or bigram features) are fed as indices taken from a finite dictionary D. This dictionary D contains all the character features which appeared in the training data.