One interesting note is that in English, which is already tokenized into words and highly polysemous, utilizing multiple embeddings per word is more effective than including multiword tokens.
in the experiments on the Chinese data, increasing the lattice size of the multicharacter tokens is more important than increasing the number of embeddings per character.