Accordingly, we spare several attention heads for modeling phrase patterns for SANs.
we use two representative types of phrases that are widely-used in SMT models: n-gram phrases (Koehn et al., 2003) to use surface of adjacent words, and syntactic phrases (Liu et al., 2006) induced from syntactic trees to represent well-formed structural information.