We observe significant improvements on distantly supervised datasets (i.e., KBP and NYT), with a up to 19% relative F1 improvement (Bi-GRU from 37.77% to 45.01% on KBP).
on the human-annotated corpus, the performance gain can be hardly noticed.