Therefore, the most ideal evaluation should be conducted by human.
motivated by this, we tested the RL systems trained with various user simulators on Amazon mechanical Turk (AmT) (miller et al., 2017), and asked Turkers to interact with the system and obtained their opinions.