On the one hand, this dataset has a high demand on various reasoning capacities: over 50% of the questions require multiple sentences to answer and also the questions come in assorted categories (what, why, how, whose, which, etc).
various types of memory networks (Sukhbaatar et al., 2015;Kumar et al., 2016) have been shown effective on these tasks, and Lee et al.