However, for example, at most 100 unique words are selected when generating a sentence of length 100.
the output length N is much smaller than the vocabulary size |V |, and this fact motivated us to reduce the large action space.