This allows using an attention-based approach of indirectly combining information (Dhingra et al., 2018;Cao et al., 2019;Song et al., 2018).
open domain question answering datasets  come with no context, and require first retrieving relevant knowledge before reasoning with it.