While we are not surprised that the positive gains are small, 7 we are surprised at how often ensemble selection hurts performance.
we investigated some of the metrics where ensemble selection hurts performance and found that ensemble selection overfits the tuning data.