Several estimates of expert inter-annotator agreement for English parsing were previously reported.
most such evaluations were conducted us-ing annotation setups that can be affected by an anchoring bias (Carroll et al., 1999;Rambow et al., 2002;.