The original decoder employs two multi-head attention layers to include both the context in encoder and decoder, while we only need one to learn the decoder context, since the context in encoder is a vector (i.e., d k ).
after applying the word and positional embeddings to (w k 0 , .