We do 10 iterations of retrofitting process for all our experiments because 10 iterations are enough for convergence (Faruqui et al., 2015) and also using the same value for all experiments avoids overfitting.
w i being the weights, α, β are set as : Further reduction in weights of noisy words can be done by taking powers of cosine similarity.