The major benefit of our proposal is that the proposed loss functions can be plugged directly into any NLP model that generates text word-by-word and that may benefit from more diverse output.
we investigated the effects of (a) varying the number N of word neighbors used to compute the loss function, and (b) removing the normalization factor by getting rid of the denominator in Eq.