The method measures each token by the z-score of its log-odds-ratio as: It uses a background corpus when calculating the log-odds-ratio δ t for token t, and controls for its variance σ 2 .
it is capable of detecting differences even in very frequent tokens.