If the NLI model predicts that a candidate contradicts a persona sentence, the candidate's score is penalized, with the penalty weighted by the NLI model's confidence 5 scaled by a constant.
assume a dialogue model Given a persona P = {p 1 , ..., p m }, previous utterances u ≤t , and a set of candidate nextutterances U , the dialogue model outputs a ranked list of scores s 1 , s 2 , ..., s |U | corresponding to next-utterance candidates u 1 , u 2 , ..., u |U | .