Retrieval-based methods surpass other methods in diversity, but it is not as good in fluency, while template-based methods outperform in fluency but suffer on diversity as expected.
we first asked human to read the simulated dialogs and rate the user simulator's performance directly.