This could be expected: intuitively, these values of α should make the model 'stretch' the probability mass.
as learning progresses, this phenomenon lessens, and the performance on rare words gets worse.