The diversity lies in question paraphrasing and different facts in the context that can be used to ask the question.
without introducing new Wikipedia articles, we make our QG model generate diverse questions for the existing contextanswer pairs in SQuAD training set by keeping the all beam search outputs for each example.