We found that running the MedLit + TR i2b2 experiment with just 25% of the i2b2 dataset with the RNN model performs as well (no significant difference) as training on the full i2b2 dataset (Figure 4), and 12% better than the model using 25% of the i2b2 data alone.
when using the BERT model, MedLit + TR i2b2 only performs better than i2b2 alone if less than 25% of the training data is available.