Dividing through by the overall probability of each context word prevents the vectors being dominated by the most frequent context words, which will often also have the highest conditional probabilities.
in this case we use linear interpolation (equation 18) because the models are roughly equally predictive and also because linear interpolation is widely used when structured language models are combined with n-grams and other information sources.