The use of directional vectors D in the Update Layer can be thought of as an alternative to the positional encodings in Transformer (Vaswani et al., 2017).
instead of updating each token embedding using neighbouring tokens embeddings with a positional encoding, we update using neighbouring token embeddings, and the directions to those tokens.