However, RL requires interaction with the environment, and obtaining real human users to interact with the system is both time-consuming and labor-intensive.
building user simulators to interact with the system before deployment to real users becomes an economical choice (Williams et al., 2017;.