While the embedding sub-space method works well for the sentiment prediction task, we would like to know its impact in other settings that are known to benefit from unsupervised embeddings.
we decided to replicate the part-of-speech tagging work in , where pretraining embeddings have been shown to improve the quality of the results significantly.