Ultimately, the choice to split the annotations to three streams and use more than one attention heads, each focusing on different types of mentions, leads to better performance.
even the multi-head supervised attentive model, does not score as well as the multiview (non-attentive) model.