Although most of the pairs have over 50% overlap rate, about 6.67% of the pairs have no nonstop-words in common, and this is mostly because of the answer offset error introduced during annotation.
we prune the training set based on the constraint: the sentence-question pair must have at least one non-stop-word in common.