Second, we find semantically-drifted questions are usually unanswerable by the given answer.
inspired by the dual learning algorithm (He et al., 2016), we propose to take the probability that a pre-trained QA model can correctly answer the generated question as a reward, i.e., p(a * |q s ; p), where a * is the ground-truth answer and q s is a sampled question.