SemCor alone attains 69.2 points, 1.3 points less than Clustercont.
indeed, language models like BERT (Devlin et al., 2019), RoBERTa , XLNet (Yang et al., 2019), etc., enable architectures built on top of them to attain performances that were previously out of reach (Wang et al., 2019).