Interestingly, strategies like ABSWHOLE-PHRASES and CONCAT-2 help the model even though the resulting recombinant examples are generally not in the support of the test distribution.
these recombinant examples are on average longer than those in the actual dataset, which makes them harder for the attention-based model.