One consequence of this forward propagation of information is that older information tends to fade from the context as new information is integrated into the context.
rNN-LMs struggle in situations where there is a long-distance dependency because the relevant information from the start of the dependency has faded by the time the model has spanned the dependency.