The proposed QG method added to the BERT-large QA model enjoys a performance boost of about 10 to 20 points, depending on the datasets, with an addition of only about 100 pre-labeled instances.
it is sufficient to add only 1K pre-labeled instances to reach the performance level of the supervised models, where its performance begins to level off.