Experimental results on NIST Chinese⇒English and WMT14 English⇒German translation tasks show that the proposed approach consistently boosts performance over both the absolute and relative sequential position representations.
several researches reveal that the sequential structure may not be sufficient for NLP tasks (Tai et al., 2015;Kim et al., 2017;Shen et al., 2019), since sentences inherently have hierarchical structures (Chomsky, 1965;Bever, 1970).