Sampling-based approximations (Mnih and Teh, 2012;Mikolov et al., 2013) to the denominator of the softmax have also been proposed to reduce calculation at training.
these methods are basically not able to be applied at test time, still require heavy computation like the standard softmax.