Among such a large set of possible actions, at most N actions are selected if the length of the generated sentence is N , where we can assume N |V |.
most of the possible actions are not selected, and the large action space slows down reinforcement learning and consumes a large amount of GPU memory.