Self-Attention Recent NMT models have improved the translation performance by treating a sentence as a subword sequence rather than a word sequence.
we extend dependency-based selfattention to work for subword sequences.