The annotators were presented with four terms at a time, and asked which term is the most positive (or least negative) and which is the most negative (or least positive).
as the difference in sentiment starts getting larger, the frequency with which the two terms are chosen as most positive begins to diverge.