It is worth noting that recent large-scale language models (LMs) (Devlin et al., 2019;Radford et al., 2018) have now been applied on this task, leading to improved state-of-the-art results (Sun et al., 2018;Banerjee et al., 2019;Pan et al., 2019).
the baseline models were developed for this dataset using hyper-parameter tun-ing; we do not perform any additional tuning.