Given ( x, y, θ), let us say that a unigram w ∈ x is relevant, irrelevant, or anti-relevant if y • θ w is respectively 0, ≈ 0, or 0.
w is relevant if its presence in x strongly supports the annotated class y, and anti-relevant if its presence strongly supports the opposite class −y.