Notice that the main purpose of the ablation study is to verify the importance of an individual component model when a significant performance drop is observed after removing it.
occasionally the overall performance may go up slightly.