We show that these parameter changes can be mapped to edge direction changes in local structures in the dependency graph, and that these correspond to problematic annotations.
the standard evaluation measures do not reflect the true quality of the evaluated algorithm.