While it is essential for certain applications, such as machine translation, this characteristic also makes it slow to apply these models to scenarios that have long input text, such as document classification or automatic Q&A.
the fact that texts are usually written with redundancy inspires us to think about the possibility of reading selectively.