We also propose some novel reward functions that evaluate the syntax of the question and semantics of the question-answer pair in its entirety.
without the coverage mechanism, we see a consistent but sufficiently lower drop (1-2%) in each evaluation measure for GE ROUGE .