We determine the effective context size by varying the number of tokens fed to the model.
at test time, we feed the model the most recent n tokens: (1) where n > 0 and all tokens farther away from the target w t are dropped.