8 As stated earlier in this paper, we did instruct annotators to select the earliest instance of an answer when there are multiple answer instances on the page.
there are still cases where different annotators disagree on whether an answer earlier in the page is sufficient in comparison to a later answer, leading to differences between annotators.