We also consider the non-uniform difficulty of IPs across various usage cases, predicted by Hypothesis 2 and shown for non-natives (Section 4.2).
to address this question, we test BERt for infelicitous choices compared to annotators' decisions: for each sentence, we compare the pronoun preferred by the model to the gold annotation.