As the number of parameters in our model is much larger than that of previous studies (Yan et al., 2010(Yan et al., , 2014Wang and Bi, 2017) due to the introduction of both a classifier and a reliability estimator, the model is much harder to train from scratch.
before we start training the model, we first pre-train the classifier using labels predicted by a simpler method as targets, using e.g.