A.2 RL Simulation Setting The main purpose of the user simulator is to provide named entities.
it is built by sampling utterances from the real dataset according to the current status of named entities.