(Collobert et al., 2011;Søgaard and Goldberg, 2016;Bingel and Søgaard, 2017).
søgaard and Goldberg (2016) showed the benefits of keeping low-level tasks at the lower layers of the network, a setting which enables higher-level tasks to make a better use of the shared representations.