In each fold, separate SVM classifiers were trained for the Collins and Charniak parses using 75% of the training data.
one system assigned role labels to the nodes in Charniak based trees and a separate system assigned roles to nodes in Collins based trees.