Recently, Reinforcement Learning (RL) approaches have demonstrated advanced performance in image captioning by directly optimizing the metric used for testing.
this shaped reward introduces learning biases, which reduces the readability of generated text.