The second drawback is that RL-based text generation is sample-inefficient due to the large action space.
the search space is of size O(|V| T ), where V is a set of words, T is the sentence length, and | • | denotes the cardinality of a set.