The two descending lines at the bottom reflect the fact that the majority-voting mechanism from the QA system was too simple: F 1 drops as K increases.
we also computed F 1 's assuming perfect voting: a voting oracle that always selects the correct answer as long as the QA system produces one, thus the two ascending lines in the center of Figure 2.