Since we have to analyse a pair of sentences, the weights should be related to not only the sentence itself, but also its partner.
ablation experiments (Mueller and Thyagarajan, 2016) illustrates a 0.04 degradation of Pearson's r without data argumentation strategy.