We used words that appear five times or more and entities that appear three times or more in the corpus, and simply ignored the other words and entities.
our vocabulary V consisted of 705,168 words and 957,207 entities.