Normally, various aspects of semantics are entangled in word embeddings (Bengio et al., 2003;Mikolov et al., 2013).
only some of the aspects are needed in specific tasks and other redundant aspects can be regarded as noise.