We find that our approach performs particularly well on the task of named entity recognition.
al (2017) which proposed to extract hidden states from pre-trained word-level language models as features for downstream NLP tasks.