Previous work on attention and pooling has only considered a small number of the possible configurations along those dimensions of attention.
the internal/external and un/weighted distinctions can potentially impact performance because external resources add information that can be critical for good performance and because weighting increases the flexibility and expressivity of neural network models.