To our knowledge, we are the first to use contrastive attention for NLP and deploy it in the sequence-to-sequence framework.
we take Transformer (Vaswani et al., 2017) as the baseline summarization model, and enhance it with a proponent attention module and an opponent attention module.