In our initial evaluations, we also tried showing the actual source (image or document) to the annotators.
we realized that this did not allow us to do an unbiased evaluation of the quality of the questions.