After some preliminary experiments we found that including all words in the frequency range from 4 • 10 3 to 1 • 10 6 in the UkWaC Corpus is a good compromise between optimal results and acceptable storage and computing efforts.
context words which have frequency range from 4 • 10 3 to 1 • 10 6 in the UkWaC Corpus have considered to construct the context vector for each words.