N-gram representations model a word type w in terms of the n-gram contexts in which w appears in a corpus.
for word w we generate the vector P (w ww )/P (w), the conditional probability of observing the word sequence w to the left and w to the right of w. The experimental section describes the particular corpora and language modeling methods used for estimating probabilities.