This effect is greatly exacerbated when performed independently on each instance.
attention mechanisms do provide a look into the inner workings of a model, as they produce an easily-understandable weighting of hidden states.