(2015) (and many others) only used the top-30k frequent words as target vocabulary, and replaced others with UNK.
the final normalization operation still brought high computation complexity for forward calculations.