• Quantification of neuron activation pattern reveals different characteristics of the context-based model and the character-based counterpart.
we think that it is necessary to maximize both the utility of word form and the advantage of the context for a better word representation.