Combining Equation 7with a reward function R (BLEU, GLEU, ROUGE, DAS, QSS and ANSS), we obtain the overall loss function using the expected reward objective as follows: where R(y, y * (i) ) denotes per sentence score (reward), Y is a set of sequences sampled from the final distribution, and α and β are tunable hyperparamters.
our framework for question generation consists of a generator and an evaluator.