The basic idea is to use an ROC-style curve to visualize the tradeoff between achieving higher reward and being faithful to human language.
(2) to our best knowledge, our work is the first comprehensive study of the use of latent variables for RL policy optimization in dialog systems.