Compared to accuracy, we adopt the F 1 score as the evaluation criterion, since accuracy might not be an indicative metric in a multi-class classification setting where the data distribution could be imbalanced.
the reward can be formulated as the Relation Classifier Removed part Figure 2: The proposed policy-based reinforcement learning framework.