By penalizing such inconsistencies, the model enables the generation of more consistent outputs.
perfect consistency between attention weights occasionally disturbs the model to generate proper outputs.