Finally, we recover the input sentence based on the predicted recover embeddings from the embedding estimator.
the input text X needs to be recovered from the perturbed text X a by fixing tokenlevel perturbations based on its approximate embeddings.