To show such grounding helps, we report results with and without grounding on those tasks in Table 4, reporting perplexity.
for Wizard of Wikipedia (knowledge) and Image Chat (images) such grounding has a clear effect.