The subject-verb agreement task is the most popular choice for evaluating the ability to capture long-range dependencies and has been used in many studies (Linzen et al., 2016;Bernardy and Lappin, 2017;Sennrich, 2017;Tran et al., 2018).
we also use this task to evaluate different NMT architectures on long-range dependencies.