The PRET+MULT framework proposed in (He et al., 2018) is a successful attempt by adopting pre-training and multi-task learning approaches.
their model only shares shallow embedding and LSTM layers between ASC and DSC (document-level sentiment classification) tasks.