For every summary sentence, a worker assigns the label correct, if the information is entailed by the document, incorrect, if it contradicts the document or contains information not present 2 , or unclear, if the worker cannot  decide.
as we cannot assume that crowdworkers are familiar with the term entailment, we ask them whether a summary sentence is "correct given the information in the article".