This is problematic for modeling language which has regular structure.
a simple and popular (McDonald, 2000;Bullinaria and Levy, 2007;Lowe, 2000) way to construct a semantic space model is to associate each vector component with a particular context word, and assign it a value based on the strength of its co-occurrence with the target (i.e., the word for which a semantic representation is being constructed).