Coherence models that purely rely on the recurrent neural networks process words sequentially within a text.
in such models, long-distance dependencies between words cannot be captured effectively due to the limits of the memorization capability of recurrent networks.