We investigate whether the effective context size varies across different types of words, by categorizing them based on either frequency or parts-ofspeech.
we vary the number of context tokens in the same way as the previous section, and aggregate loss over words within each class separately.