In order to guarantee the quality of created question-answer pairs, we use a strict quality control procedure during data annotation.
30% annotated data from each group are randomly sampled and passed to the three reviewers  who will review all answers created by the workers and correct answers if they consider they are wrong.