These results show that our method easily fits in the memory of the single GTX 1080 GPU, whereas "Full softmax" is very sensitive to the vocabulary size |V | and the sentence lengths.
we observe about 56% reduction in memory usage when using the En-Ja (2M) dataset.