We use PMI and LLR to compute the association score (AS) between the term and each of the context to generate the context vector.
this results in an average stream size of 194 million word pair tokens and 33.5 million word pair types per chunk.