We currently model S θ (s | u) as the probability that a left-to-right stochastic contextual edit process ( Figure 2) would edit u into s. This probability is a sum over all edit sequences that produce s from u-that is, all s-to-u alignments.
with certain fancier approaches to modeling S θ , which we leave to future work, this effect could be mitigated while preserving the transducer property.