Question answering for reading comprehension in general has seen a great deal of recent work (Rajpurkar et al., 2016;Joshi et al., 2017), and there have been many recent attempts to construct QA datasets that require advanced reasoning abilities Welbl et al., 2018;Mihaylov et al., 2018;Zellers et al., 2018;.
these attempts typically involve engineering data to be more difficult by, for example, explicitly prompting users to write multi-step questions Mihaylov et al., 2018), or filtering out easy questions (Zellers et al., 2018).