As discussed in section 2.2.1 DAS will give high reward even though the generated question has low BLEU score.
the performance of the model on automatic evaluation metrics does not improve with DAS as the reward function, though the quality of questions certainly improves.