Future work will involve incorporating a diverse set of domain specific KBs for specialized NLP applications.
large pretrained models such as ElMo (Peters et al., 2018), GPT (Radford et al., 2018), and BERT (Devlin et al., 2019) have significantly improved the state of the art for a wide range of NlP tasks.