Note that the metric for the STS-B task is Pearson and Spearman scores.
we measured the validation Pearson score instead of validation accuracy for choosing influential attention heads for the STS-B task.