To make the comparison as fair as possible, we consider only words that were observed in the training data.
we also notice that the model sometimes attends to features like Aspect, Polarity, and Verb-Form-since these features are present only on verbs, we suspect that the model may simply use them as convenient signals that a word is verb, and thus a likely head for a given noun.