In principle, the penalty for replacing a word should depend on both the probability that it is wrong (as for noise removal) and on the similarity between the wrong word and the proposed replacement.
the higher the probability that a word is wrong, and the higher the similarity between the original word and the replacement, the lower the penalty for the replacement.