Motivated by these limitations, we propose a context-sensitive morphoRNN (csm-RNN) which integrates RNN structures into NLM training, allowing for contextual information being taken into account in learning morphemic compositionality.
we adopt the NLM training approach proposed in  to learn word embeddings, but build representations for complex words from their morphemes.