Mitchell (2011) restricts the history so that only words outside the trigram window are taken into account in order to keep the n-gram model and the semantic similarity model independent.
the n-gram model represents local dependencies, and the semantic model represents longer-distance dependencies.