At first glance this might seem like a substantial improvement over the shallow windowbased approaches, which scale with the corpus size, |C|.
typical vocabularies have hundreds of thousands of words, so that |V | 2 can be in the hundreds of billions, which is actually much larger than most corpora.