The negative loglikelihood loss function for NAT model become is then defined as: The approach breaks the dependency among the target words across time, thus the target distributions can be computed in parallel at inference time.
the encoder stays unchanged from the original Transformer network.