Recent NMT models treat a sentence as a sub-  word sequence rather than a word sequence to address the translation of out-of-vocabulary words (Sennrich et al., 2016).
we extend dependency-based self-attention to operate at subword units created by byte pair encoding (BPE) rather than word-units.