Moreover, as such a method does not rely on any extra assumptions, it can serve as our default training method for T. With Prior Knowledge of Data Quality On the other hand, if we happen to have prior knowledge about which part of the training data is more reliable and which is less reliable, we can utilize this knowledge as guidance to design the curriculum.
we can build a curriculum by first training the prediction branch on the reliable data for several epochs, and then adding the less reliable data to train the full model.