The proposed methods also improve actual computation time in both training and test.
on CPU, where the computation speed is directly affected by the size of the output layer, the proposed methods translate significantly faster than Softmax by x5 to x20.