In this paper, we investigate three ways to perform MetaUpdate as described in the following parts.
(2019) propose to combine multi-task learning with language model pre-training and demonstrate the two methods are complementary to each other.