An alternate technique is to use word-classing (Goodman, 2001;Mikolov et al., 2011), which can reduce the cost of exact normalization to O( √ V ).
our approach is much more scalable, since it is trivially parallelized in training and does not require explicit normalization during evaluation.