Various non-autoregressive translation models, including our own CMLM, make the strong assumption that the individual token predictions are conditionally independent of each other.
our decoder is bi-directional, in the sense that it can use both left and right contexts to predict each token.