RNNs trained specifically to perform the agreement task can achieve very good average performance on a corpus, with accuracy close to 99%.
error rates increase substantially on complex sentences (Linzen et al., 2016, suggesting that the syntactic knowledge acquired by the RNN is imperfect.