In order to alleviate these issues, we introduce an RNN-LM that utilizes both character-level and word-level inputs.
since the word embedding part is independent from the language modeling part, our model retains the flexibility to change the architecture of the language modeling part.