The fragment categories are disregarded in this evaluation and the system's result is considered correct even if its output category does not match the one marked by the annotators.
using the POS tags produced by the POS tagger instead of the ones produced by the parser, the "Parse + Tag" model achieved a precision of 0.84, a recall of 0.62 and an F 0.5 of 0.78, improving upon the results of the "Parse" model and significantly outperforming all four baselines 5 .