The QG models are based on BERT-HLSQG (Chan and Fan, 2019), with the hyperparameters provided by the authors and minor modifications to apply penalized sampling as in Keskar et al. (2019).
the second example suggests that our model suffers from the problem of handling pronouns.