Clearly, the automatically labeled datasets in distant supervision contain amounts of sentences with wrong relation labels.
previous works only focus on wrongly labeled instances in training sets but neglect those in test sets.