This method could match or outperform existing models that learns generic embeddings in an unsupervised setting, often requiring several days or weeks to train .
the use of gating for selecting word representations has been considered in previous work.