Thus, using the distillation loss for training, the student learns to use both seed words and non-seed words to predict aspects.
the aspect embeddings A k are initialized by clustering the vocabulary embeddings using kmeans with K clusters.