Then, during RL stage, the conventional way is to adopt self-critical strategy to fine-tune based on the target evaluation metric, Distributional Semantic Reward During evaluating the quality of the generated sentences, ROUGE looks for exact matches between references and generations, which naturally overlooks the expression diversity of the natural language.
it fails to capture the semantic relation between similar words.