Then, we combine the information in the obtained sequence m i,1 , ..., m i,n in a similar manner as in the ATT-POOL model using the attention mechanism, but this time, with self-attention, that is, computing the weights of the elements in the sequence based on the relatedness to the element inside the sequence.
the number of attentions that must be computed is reduced to nq.