Adopting a more pragmatic view on argument structure also has the advantage that it is suitable for annota- tion or validation of automatic output using crowdsourcing 13 , which is a commonly used method for evaluating Human Language Technology (HLT) systems (Callison-Burch, 2009;Passonneau and Carpenter, 2013).
the crowdsourcing Human Intelligence Task (HIT) was designed as a validation task (as opposed to annotation), where each system-proposed link and labels are presented to a human contributor for their validation with both article sentence and comment sentence placed within context (see Fig.