In the field of lexical semantics, the contextual information is useful for representing the meaning of words, phrases, as well as sentences (Mitchell and Lapata, 2008;Erk and Pado, 2008;Thater et al., 2010;Ó Séaghdha and Korhonen, 2011;Grefenstette et al., 2011).
the co-occurrences between a target word (the gap) and its context words have been commonly used in statistical approaches to measuring the substitutability of words.