It shows that more than half or more than a third of all questions in SQuAD or NewsQA, respectively, are (partially) answerable by a very simple neural BoW baseline.
the gap to state-of-the-art systems is quite large (≈ 20%F1) which indicates that employing 77.9 69.5 FastQA w/ beam-size k = 5 77.1 68.4 FastQAExt k = 5 78.9 70.8   Tables 2 and 3 clearly demonstrate the strength of the FastQA system.