A relatively small decrease in the weights of high-frequency tokens will prevent the generation probabilities of ground-truth tokens from ascending continually, which may result in an obvious degradation of the overall performance.
we ensure that all the token weights are equal to or bigger than 1 considering the training stability as well as designing convenience.