Semantics-Reinforced Models As shown in Table 3, when using QAP and QQP separately, all metrics are significantly (p < 0.001) improved over our baseline and all metrics except ROUGE-L are significantly (p < 0.05) improved over the models using traditional metrics as rewards.
these metrics sometimes fail to evaluate equally to question paraphrases and thus provide inaccurate rewards.