Building a single model that jointly learns to perform many tasks effectively has been a longstanding challenge in Natural Language Processing (NLP).
multi-task NLP remains difficult for many applications, with multi-task models often performing worse than their single-task counterparts (Plank and Alonso, 2017;Bingel and Søgaard, 2017;McCann et al., 2018).