Overall, by simply incorporating more information on word relations, we gain approximately 10 points in both MAP and MRR compared to surface-form matching (Line #4 vs. #2), consistently across all three models.
adding more information like named entity matching and answer type verification does not seem to help much (Line #5 vs. #4).