This way, the models do not let information fade away from the context as it progresses to subsequent steps in a sequence and all previous information about the words that preceded the current timestep is available to the classifier in a manner that disregards recency.
of the smoothing effect, the model does not necessarily need to store information about the context of the sequence in the recurrent connections of the RNN.