We hypothesize that after a certain limit, larger context windows will produce more noise than helpful information for the prediction.
we set the window-size to 3 in all of our experiments involving Window-context model (all with a separate test set).