Word embeddings learned by neural language models (Bengio et al., 2003;Collobert and Weston, 2008;Mikolov et al., 2013b) have been successfully applied to a range of tasks, including syntax (Collobert and Weston, 2008;Turian et al., 2010;Collobert, 2011) and semantics (Huang et al., 2012;Socher et al., 2013b;Hermann et al., 2014).
phrases are critical for capturing lexical meaning for many tasks.