In this work, we propose to improve the information aggregation for multi-head attention with a more powerful routing-by-agreement algorithm.
the routing algorithm iteratively updates the proportion of how much a part (i.e.