That is, we examine language model behavior on artificially constructed sentences designed to expose behavior that is crucially dependent on syntactic state representations.
we study complex subordinate clauses and garden path effects (based on mainverb/reduced-relative ambiguities and NP/Z ambiguities).