In typical RL settings, the learner is typically initialized to a random policy distribution.
in our case, since some supervision is already available in the form of target sarcastic sentences, we pretrain the model with the loss minimization objective given in Eq.