While not strictly proven, we conjecture one possible reason for the unsatisfying performance is the low reliability of the Hanja tagger we leveraged, which is not guaranteed to work well with spoken language.
we have manually inspected the tagging results and observed that there are some errors which can lead to performance degradation.