(2015a) by using a smoothed version of pointwise mutual information (PMI), where we use 0.5 as exponent factor.
for each word w ∈ V, the set R contains all sufficiently frequently co-occurring pairs (w, v) for which v is within the top-100 most closely related words to w, according to the following score: where n wv is the harmonically weighted 3 number of times the words w and v occur in the same sentence within a distance of at most 10 words, and: This smoothed variant of PMI has the advantage of being less biased towards infrequent (and thus typically less informative) words.