Nonetheless, this feature is extremely important; given two sentences with equivalent meaning, we would expect a good model to produce two outputs with equivalent meaning.
any meaningpreserving perturbation that results in the model output changing drastically highlights a fault of the model.