Judging alternatives based on short sentential context only is a challenging task, and we decided to exclude from further analysis those pairs that were not rated consistently by the subjects.
we discarded all pairs whose inter-subject variance was not significantly below chance at α = 0.1, based on simulated chance variance distributions.