Currently, few studies focus on the evaluation based on the group of references, which is more meaningful and reasonable for NRG models.
we proposed three metrics: MaxBLEU, Mean Diversity Score, and Probabilistic Diversity Score, to quantify both the relevance and diversity of the generated responses.