LSH achieves better BLEU than decoding with top frequent words of the same run-time vocabulary size C on attention models.
it in-troduces too large an overhead (50 times slower), especially when softmax is highly optimized on GPU.