To obtain a combined training objective of two tasks, we add the loss of question type prediction into the loss of question generation to form a total loss function: 3 Experiment Dataset Following the previous works, we conduct experiments on two datasets, SQuAD and MARCO.
we reduce the question type vocabulary to only question words.