In addition to BERT's pre-training objective, ERNIE also masks entities and trains the model to predict them.
with both KNOWBERT and EAE, ERNIE takes entity linking as an input rather than learning to do it inside the model.