First, we use smoothed frequency counts instead of the observed frequency counts x ij .
the PMI between words i and j is given as: where the probabilities are estimated as follows: where α ≥ 0 is a parameter controlling the amount of smoothing and n is the size of the vocabulary.