Because we gather evidence using an automated process, the documents are not guaranteed to contain all facts needed to answer the question.
they are best seen as a source of distant supervision, based on the assumption that the presence of the answer string in an evidence document implies that the document does answer the question.