The reason might be that the autoencoder trained with denoising task will be insensitive to the word embedding revision of CRQDA.
some revisions guided by the MRC gradients might be filtered out as noises by the autoencoder, which is trained with a denoising task.