We also consider unsupervised transfer learning where the correct answer to each question in the target dataset is not available.
the entire process is supervised during pre-training, but unsupervised during fine-tuning.