Early works mainly focused on the shared representation methods (Liu et al., 2017;Tong et al., 2018;Lin et al., 2018), using a single shared encoder between all tasks while keeping several task-dependent output layers.
the sparseness of the shared space, when shared by K tasks, was observed (Sachan and Neubig, 2018).