(2017) found it is beneficial to capture different context with multiple individual attention functions.
as seen, the disagreement score on the individual component indeed increases with the corresponding regularization term.