After discussion between the authors on disputed annotations to create "gold standard" annotations, we found that 40 of the 100 relations in our random sample were correct according to this criterion.
40% of the relations extracted were exactly correct or would be correct with the use of minor post-processing consisting of lemmatization and removal of common types of qualifying words.