We define the difference of likelihood between them as the reward to evaluate the performance of our policy.
the reward is defined as follows: where L and U is the subset of labeled data and unlabeled data respectively, and y is the relation label given by DS.