The hierarchical softmax (Morin and Bengio, 2005) predicts each word based on binary decision and reduces computation time to O(H log V ).
this method still requires O(HV ) space for the parameters, and requires calculation much more complicated than the standard softmax, particularly at test time.