While disabling some heads improves the results, disabling the others hurts the results.
it is important to note that across all tasks and datasets, disabling some heads leads to an increase in performance.