As shown, the gaps of success rates between the models are not very large, because all models can give pretty high success rate.
as expected, our proposed MHA provides lower perplexity (PPL) 1 , which means the examples generated by MHA are more likely to appear in the corpus of the evaluation language model.