An interesting difference is that for ELMo, syntax is more helpful for arguments very far from the predicate.
for RoBERTa, syntax is helpful on arguments 4-7 tokens away from the predicate, but hurts performance on arguments farther away from the predicate.