Comparing these labels with the ground-truth test labels yields an overall GLUE score of 87.1-well above BERT's 80.5 and Big-Bird's 82.9-and yields single-task scores that are substantially better than both on six of nine tasks.
our annotators, however, are only given 20 examples and a short set of instructions for training, while BERT and BigBird are fine-tuned on the 364k-example QQP training set.