We propose such a method based on word order permutations which allows us to manipulate word order properties analogously to familiar wordlevel properties and study their effect on parsing performance.
given a dependency treebank, we obtain new synthetic data by permuting the original order of words in the sentences, keeping the unordered dependency tree constant.