Since the output of the model is assignments to discovered states for utterances, not pre-determined DA labels, we use a clustering evaluation method, as adopted by previous work on unsupervised DA modeling.
we use homogeneity, completeness, and v-measure as metrics (Rosenberg and Hirschberg, 2007).