Second, as the model becomes better at the game, we observe an increase in the length of dialogue.
it remains shorter than the average length of human dialogues, possibly because our reward function is designed to minimize it, which worked better in experiments.