(2010) were able to improve near state-of-the-art systems for several tasks, by simply plugging in the learned word representations as additional features.
because these features are estimated by minimizing the prediction errors made on a generic, unsupervised, task they might be suboptimal for the intended purposes.