Their results show that the BERT model captures syntax-sensitive agreement patterns well in general.
subject-verb agreement cannot provide more nuanced tests of other complex structures (e.g., dependency structure, constituency structure), which are the interest of our work.