Competitors slightly outperform our models in IMDB, since its unique character that the sequences are much longer than other datasets.
lK-MTl surpasses the PA-MTl, which result demonstrates that the memory and forgetting mechanisms in leaky unit indeed have advantages over other sharing approaches, which help distinguish the helpfulness of the features and making a balance between features in current task and borrowed features.