The vocabulary size |V | is usually more than ten thousands for datasets covering many sentences with a variety of topics.
for example, at most 100 unique words are selected when generating a sentence of length 100.