Indeed, Table  3 shows that we can improve agreement precision by setting θ agr to the (positive) mean agreement score µ assigned by the SVM agreement-classifier over all references in the given debate 12 .
this comes at the cost of greatly reducing agreement accuracy (development: 64.38%; test: 66.18%) due to lowered recall levels.