Based on massive amounts of data, recent pretrained contextual representation models have made significant strides in advancing a number of different English NLP tasks.
for other languages, relevant training data may be lacking, while state-of-the-art deep learning methods are known to be data-hungry.