In the following, x is the cue word and y a (possible) response word.
p(x) is the probability of observing x, and p(x) refers to the probability of not observing x. Pointwise Mutual Information (hereonin PMI) was introduced in Section 2.