Instead, it is trained by optimizing the distillation objective, i.e., the cross entropy between the teacher's (soft) predictions and the student's predictions: While the teacher only uses the seed words in s i to form its prediction q i , the student uses all the words in s i .
using the distillation loss for training, the student learns to use both seed words and non-seed words to predict aspects.