The single model trained only on SQuAD is outperformed on all four of the datasets by the multitask model that uses distant supervision.
performance when training on SQuAD alone is not far behind, indicating that task transfer is occurring.