Pre-trained contextualized word embeddings (Peters et al., 2018;Devlin et al., 2019;Radford et al., 2018) have become increasingly common in natural language processing (NLP), improving stateof-the-art results in many standard NLP tasks.
beyond standard tasks, NLP tools are also vital to more open-ended exploratory tasks, particularly in social science.