Therefore, we suggest that the handcrafted user simulation is not sufficient to be used in evaluating dialog systems because it does not generate user actions that are as similar to human user actions.
the handcrafted user simulation is still better than a user simulation trained with not enough training data.