Although not the primary focus of this work, we find that SMTL and MTL can be significantly improved in low resource setting through weighted sampling of tasks during training.
as standard in multi-task learning, the weights at the output layer (g) are task-specific in both settings.