We assume ε cannot be applied with the sequence pair (s, t) if s = x, then we have the transition function δ as follows, where s • x represents concatenating a sequence s and a word x.
to provide this information explicitly, we embed the number of previous delay tokens to a vector and add this to the sum of the word embedding and position embedding as the input of the decoder.