We have also observed that injecting character information into word representations is always beneficial because this mitigates the above-mentioned sparsity issues.
the extent of the gain in perplexity partly depends on some typological properties that regulate the ambiguity of the mapping between morphemes (here modeled as character n-grams) and their meaning.