We follow this approach using our RNN as well as the BERT model where we first tune BERT to the MedLit data and then continue to tune that model on the EHR data.
it is common that the exact format of sections in a particular EHR does not adhere to known patterns.