The Prague Treebank reported a disagreement of about 10% for manual thematic role assignment (Žabokrtský, 2000).
in contrast to our study, they also annotated temporal and local modifiers, which are easier to mark than other roles.