We further investigate the combination of transferring the policy network with transferring the underlying learner.
we first train a classifier on all of the annotated data from the source domain/language; this classifier is then transferred to the target task and further fine-tuned using the collected labelled data.