In this work, we consider an approach for training paragraph captioning models that focuses on increasing the diversity of the output paragraph.
we note that self-critical sequence training (SCST) (Ranzato et al., 2015;Rennie et al., 2016), a technique which uses policy gradient methods to directly optimize a target metric, has been successfully employed in standard captioning, but not in paragraph captioning.