To exploit these observations, in AE-SCL-SR the reconstruction matrix w r is pre-trained with a word embedding model and is kept fixed during the training and prediction phases of the neural network.
the i-th row of w r is set to be the vector representation of the i-th pivot feature as learned by the word embedding model.