The orange points in Figure 4 show the performance of this experiment with different context sizes k. We observe that including shuffled distant words is substantially better than truncating them completely.
shuffling does cause performance to degrade relative to the base parser even when the unshuffled win-  dow is moderately large, indicating that the LSTM is propagating information that depends on the order of words in far-away positions.