In the training process, we apply the pairwise ranking strategy (Collobert et al., 2011) to tune model parameters.
we calculate the ROUGE-2 scores (Lin, 2004) of all the sentences in the training dataset.