In CV annotation it is typical to remove infrequent terms from both the keyword vocabulary and the evaluation data because CV algorithms typically need a large number of examples to train on.
using NLP systems and baselines one can correctly annotate using keywords that did not appear in the training set.