This is also consistent with our empirical findings, that the uniform distribution centered by the mean of all word vectors in the documents is generally applicable for various text corpora.
if d is the dimensionality of the pre-trained word embedding space, we can draw a random word u 2 , and where v min and v max are some constants.