Traditional reinforcement learning requires thousands of dialogues, which are difficult to collect with real users.
a user simulator which simulates the behavior of real users is used for generating training dialogues.