Each entity is only mentioned a few times (less than 5 on average, with a long tail), and with more than thousand different relations.
it is clear that regular language models would not be able to generate factual text, and there is a need for language models to be able to refer to external sources of information.