Inspired by these studies, we propose more flexible strategies for modeling localness for self-attention networks in this work.
we cast the localness modeling as a learnable Gaussian bias, in which a central position (i.e.