In this work, we investigate the possibility to combine the two models into a unique framework and develop efficient architecture to leverage both advantages.
we propose Double Path Networks for Sequence to Sequence learning (DPN-S2S), which contain a convolutional path and a self-attention path with attention information fusion between the encoder and the decoder.