At the same time, the same technology fails to achieve performance improvements on TACRED, the human annotated dataset.
we found that, by explicitly adapting the model along label distribution shift, consistent improvements can be achieved on distant supervision but not on human annotations.