Unfortunately, n-gram diversity is computed across contexts by counting the number of unique n-grams generated, and so does not measure a model's ability to generate multiple valid utterances at any single context.
a model which only outputs a single memorized utterance per context (e.g., via memorization or retrieval) can still have high n-gram diversity as long as the memorized sentences differ across contexts.