Our window-based approach, by considering the neighboring words, already captures short-term dependencies like this from the future.
it requires tuning to find the right window size, and it disregards long-range dependencies that go beyond the context window, which is typically of size 1 (i.e., no context) to 5 (see Section 5.2).