of target word occurrences in context, we experiment with dropping all the distant context versus dropping only occurrences of the target word from the context.
we compare removing all tokens after the 50 most recent tokens, (Equation 1 with n = 50), versus removing only the target word, in context of size n = 300: where f word (w, span) drops words equal to w in a given span.