In addition to marking only a subset of the incorrect tokens at inference time, we also train new models for which the training data also only had a subset of incorrect tokens marked.
the system presents an initial translation to the user who can accept a prefix and select among the most likely postfix iteratively.