However, we found that most boundaries are actually only influenced by nearby EDUs, thereby forcing the model to attend to the whole sequence will bring in unnecessary noises.
we propose a restricted self-attention mechanism, which only collects information from a fixed neighborhood.