Honey pots or trap questions whose answers are known a priori are often included in a HIT to identify turkers who are unable to solve the task appropriately leading to incorrect annotations.
this trick cannot be employed in our case because there is no notion of an absolutely correct segmentation.