If the system used for collection makes an error at turn t, the labeled dialog only includes the sub-dialog up to turn t, and the system being evaluated off-line is only evaluated on that sub-dialog.
in our case, reporting dialog accuracy would favor the HCN because it would be evaluated on fewer turns than the rule-based system.