(2018) fed external world knowledge (ConceptNet relations and coreferences) explicitly into MAGE-GRU (Dhingra et al., 2017) and achieved improvements compared to only using the relational arguments.
we here show that it works even better when we learn this knowledge implicit through next sentence prediction task.