(2017) is that they use the ROUGE scores to label the top (bottom) 20 sentences as positive (negative), and the rest are neutral.
we found it better to train our model to directly predict the ROUGE scores, and the loss function we used is Mean Square Error.