By analyzing the outputs, the increased number of layers or heads results in better capability to simplify the words.
models with the greater number of layers or heads tend to remove the normal words and add simplified words.