In order to alleviate these issues, we introduce an RNN-LM that utilizes both character-level and word-level inputs.
our model has a gate that adaptively choose between two distinct ways to represent each word: a word vector derived from the character-level information and a word vector stored in the word lookup table.