Using edit distance in the flow setup helps alleviate this issue, since a misstep of insertion or deletion by the neural model will still generate a string that resembles the ground truth in terms of edit distance.
the edit distance based flow can still recover from the mistakes the neural model makes.