A pretrained sentiment scorer is used to evaluate how well the sampled sentenceŷ matches the target sentiment intensity value v y .
the reward for sentiment transformation is formulated as: where ϕ refers to the pre-trained sentiment scorer which is implemented as LSTM-based linear regression model.