By relying on memorization, existing language models are unable to generate factually correct text about real-world entities.
they are unable to capture the long tail of rare entities and word types like numbers and dates.