Modeling this interaction, we believe, is the reason for the superior performance of SWAP-NET in our experiments.
let α s kj denote the probability of selecting the k th input sentence at the j th decoding step of sentence decoder: and let α w ij denote the probability of selecting the i th input word at the j th decoding step of word decoder: both conditional on the corresponding switch selection.