Recent NLP advances have been powered by improved representations (e.g., ELMo, BERT- Peters et al., 2018;, novel neural architectures (e.g., Cheng et al., 2016;Seo et al., 2017;Parikh et al., 2016;Vaswani et al., 2017), and large labeled corpora (e.g., Bowman et al., 2015;Rajpurkar et al., 2016;Williams et al., 2018).
we have seen progressively improving performances on benchmarks such as GLUE .