Taking advantage of the dual annotations provided for each sentence in the SSR corpus, we can report double-reference evaluation.
we judge that if a hypothesized cleaned sentence exactly matches either reference sentence cleaned in the same manner we count the cleaned utterance as correct, and otherwise we assign no credit.