(2018), we propose a novel Transformer NMT model that incorporates the relationships between two words on source dependency structures into relative position representations in self-attention.
the proposed model adds a vector that encodes relative positional relationships between words on source dependency structures to a word embedding vector.