n-gram representations, which we call n-GRAM-R, model a word type w in terms of the n-gram contexts in which w appears in a corpus.
for word w we generate the vector P(w ww )/P(w), the conditional probability of observing the word sequence w to the left and w to the right of w. Each dimension in this vector represents a combination of the left and right words.