Neural models Mikolov et al., 2010;Józefowicz et al., 2016) have recently shown great improvement.
most of them share a common issue: a large output vocabulary implies a prohibitive computation time, due to the output normalization, along with a prediction challenge in a such high dimensional space.