Because IDS requires human intervention to reduce risks whenever there is low confidence, we calculate the average turn accuracy only if IDS chooses to respond without human intervention.
(2018) have reserved a few bits in the dialogue state for the domain extension.