Note that s (k) , s (k+1) , ..., s (k+n) may be the same.
the probability to generate the response u (k+1) is computed as: Figure 1 shows the framework of the proposed Incremental Transformer with Deliberation De- (1) coder.