The requirement of same arc label annotation is mainly needed for evaluation using the Labelled Attachment Score (LAS).
the error rate reduction is from 15.8% down to 6.5% for training data sizes from 1k to 15k tokens.