We also experimented with using the most frequent 10000, 20000, and 25000 words, however, the results in the crossvalidation experiments were lower.
(2018) offered a new word embedding representation model named as ELMo.