Direct use of TF-IDF leads to serious out-ofvocabulary (OOV) problem and high variance, because we need to sample poems during the training process of DRL, which causes many OOV words.
we use another neural network to smooth TF-IDF values.