Several authors investigate neural network models that learn not just one latent state, but rather a vector of latent variables, to represent each word in a language model (Bengio et al., 2003;Emami et al., 2003;Morin and Bengio, 2005).
what is the effect of smoothing on sequencelabeling accuracy for rare word types?