As a result, with the increase of the document length, the improvement produced by TA gets more evident.
the global semantics introduced by TA is indeed helpful to Transformer-based models on the summarization task, especially for long documents.