Little performance boost is shown on SciTail, probably because sentences in SciTail are more focused on the expressions of concepts and knowledge, and thus key words are more about verbs and nouns rather than named entities.
as we unexpected, applying NPB-BPE * to SST-2 gains a 0.6% absolute increase.