(2) Part-of-Speech Tagging For the semantic out-of-context substitutions, only certain part-of-speech (POS) classes are taken into account.
every token in the dataset needs to be assigned a POS category.