Table 5 shows that simply using of the embeddings trained on the MIMIC-III notes significantly increases the accuracy for all the models.
the maximum gain is 2.4%, 0.9%, and 0.3% for the BOW, In-ferSent, and ESIM models correspondingly.