In particular, we explore unlabeled data to transfer the predictive power of hybrid models to simple sequence models.
hybrid systems are utilized to create large-scale pseudo training data for cheap models.