Only if the users are disencumbered from speech-recognition errors are they able to reliably assess the mutual influence of the observable less significant contributors to their satisfaction with the dialogue manager's performance.
in our WOZ experiments (Section 2), which were carried out in order to evaluate the performance of the dialogue manager, speech understanding (i.e., speech recognition and natural-language understanding) was performed by a human.