Therefore, we propose to learn a hybrid representation which can summarize information from both characters and words.
we first learn two separate character-level and word-level representations using token-level neural networks.