The literature on distributional semantics is vast; in this section we focus on outlining the research that is most directly related to capturing effects of context and compositionality.
we follow recent work (Dinu and Lapata, 2010;Ó Séaghdha, 2010;Ritter et al., 2010) in assuming a latent variable model that associates contexts with distributions over a shared set of variables and associates each variable with a distribution over the vocabulary of word types: The set of latent variables Z is typically much smaller than the vocabulary size; this induces a (soft) clustering of the vocabulary.