In this context, various approaches based on modifying the RNN or LSTM architecture have been proposed to speed up the process (Seo et al., 2018;Yu et al., 2017).
the processing in these models is still fundamentally sequential and needs to operate on the whole document which limits the computational gain.