In general, we observe an overall lower score for trl models that use the DIP2016 corpus compared to those using the SemEval corpus.
to the mtl model, for trl models all parameters are transferred to the main task, not just parameters that represent shared knowledge.