ing has focused on integrating external knowledge (linguistic and/or knowledge-based) into recurrent neural network models using Graph Neural Networks (Song et al., 2018), Graph Convolutional Networks (Sun et al., 2018;De Cao et al., 2019), attention (Das et al., 2017;Mihaylov and Frank, 2018;Bauer et al., 2018) or pointers to coreferent mentions (Dhingra et al., 2017).
in this work we examine the impact of discourse-semantic annotations ( Figure 1) in a self-attention architecture.