System performance on the sliced challenge sets (Table 5) shows that performance indeed decreases with d. Results thus indicate that it is not only the presence of the phenomena that make these sets challenging, but that the challenge increases with the distance.
in this case, systems that are predisposed towards monotonic decoding are likely to present lower performance, while systems that have no predisposition as to the order of the target side tokens relative to the source-side tokens are not expected to show any change in per-formance.