Previous studies evaluate simulated dialog corpora using evaluation measures which can be automatically extracted from the dialog systems' logs.
the validity of these automatic measures has not been fully proven.