Comparing with the default sampling algorithm, it has similar entity extraction performances, but its behaviour on the relation extraction is different.
adding entity loss in ∆(ŷ, y) (i.e., ∆ E , ∆ E+R ) now affects relation results negatively.