They observe half of the WER reduction that the fully supervised methods achieve.
a closer look reveals that the syllable-based CM paired with NO-LM is an outlier because NO-LM approach allows variety at the output but when the unit of the confusion model is as small as syllables, it produces too much variety that deterio-rates the discriminative model.