For a given task, only a subset of all the latent aspects captured by the word embeddings will be useful.
instead of updating the embeddings directly with the available labeled data, we estimate a projection of these embeddings into a low dimensional sub-space.