Both strategies perform better than the standard multi-head aggregation (Row 1), verifying the effectiveness of the non-linear aggregation mechanisms.
the two strategies require comparable parameters and computational speed, but EM routing achieves better performance on translation qualities.