This may be due to nature of neural networks (Feng et al., 2017): during training, a neural network tunes its parameters to learn how to simplify different aspects of the sentence, which means that all the simplification rules are actually contained in the shared parameters.
if one simplification rule appears more frequently than others, the model will be trained to be more focused on it than the infrequent ones.