These examples also demonstrate that SPM successfully reduces odd-gen. We visualize the prediction of the SPM and the attention distribution to see the acquired token-wise correspondence between the source and the target.
we feed the source-target pair (X, Y ) to EncDec and EncDec+SPM, and then collect the source-side prediction (q 1:I ) of EncDec+SPM and the attention distribution (α 1:J ) of EncDec 12 .