The values for our cost-sensitive systems (LABEL, LABELD, CHILDPOSD, HEADPOS, HEADPOSD) are never above 1, which means that we are selectively underfitting the parser for specific syntactic phenomena.
we use the doubly-annotated data to regularize our model, hopefully preventing overfitting to annotators' biases.