(2015) proposed a model called distillation and were able to train a model which was more compact than the original one.
it needs a lot of time for training since it needs to be trained again for distillation.