In the case of the third and fourth documents, there is actually content further down in the document which is relevant to the topics the human annotators select, but it is not apparent in the document snippet presented to the annotators.
the effect is caused by resource limitations for the annotation task, that our automated method does not suffer from.