This may be due to the indiscriminately high confidence scores; or it could indicate that classifiers, which are geared at distinguishing between known classes rather than detecting objects that differ from all seen data, are not optimally suited to the task.
one further disadvantage of this approach is that, as mentioned above, it can only be applied to lemmas with more than one annotated sense.