Neural networks have proven highly effective in natural language processing (NLP) tasks, outperforming other machine learning methods and even matching human performance (Hassan et al., 2018;Nangia and Bowman, 2018).
supervised models require many per-task annotated training examples for a good performance.