Similarly, let θ s denote parameters to be learned for the student model, and denote the corresponding probability output from the student model.
the distance between the teacher's prediction and the student's prediction can be defined as: where c is a class label and C denotes the set of class labels.