Regarding the compression method proposed in this paper, we notice that LSTM-z,wb and LSTM-z,w yield similar performance to LSTM-z.
in this paper, we propose to compress neural language models by sparse word representations.