From the table we can see that each of our model components can provide from 1% to 2% relative gain over the QA performance.
using a 1-layer fusion block leads to an obvious performance loss, which implies the significance of performing multi-hop reasoning in HotpotQA.