Previous work has modeled the compositionality of words by creating characterlevel models of meaning, reducing problems of sparsity for rare words.
in many writing systems compositionality has an effect even on the character-level: the meaning of a character is derived by the sum of its parts.