We approximate the expectation E P G (q|p,a) by sampling one instance at a time from P G (q|p, a) and then do an update step.
there is discrepancy between the model-generated data distribution and the human-generated data distribution, which leads to suboptimal discriminative models.