Intuitively, NAT abandon feeding previous predicted words into decoder state at the next time step, but directly copy source encoded representation (Gu et al., 2017;Lee et al., 2018;Guo et al., 2018;Wang et al., 2019) as inputs of the decoder.
the generation of the NAT models does not condition on previous prediction.