In this evaluation, the system is provided with the utterance and the goal emotion in the test data and the generated responses are evaluated through BLEU score.
table 9: Examples of utterance-response pairs to which the system predicted wrong emotions.