Then, we combine the information in the obtained sequence m i,1 , ..., m i,n in a similar manner as in the ATT-POOL model using the attention mechanism, but this time, with self-attention, that is, computing the weights of the elements in the sequence based on the relatedness to the element inside the sequence.
our proposed models extend end-to-end style SRL systems using deep bi-RNN (Zhou and Xu, 2015;He et al., 2017;ouchi et al., 2017) to combine mechanisms that consider multiple predicate interactions.