We propose two variants of MHA, namely a black-box MHA (b-MHA) and a white-box MHA (w-MHA).
in contrast to previous language generation models using M-H, b-MHA's stationary distribution is equipped with a language model term and an adversarial attacking term.