The output of ABS-LSTM at l th time step is: Global Interaction Attention (GIA): Inherently, LSTM has the capability to 'memorize', and uses the memory to sequentially model long-term dependency.
the hidden states output by ABS-LSTM synthesize the information from current time step's input interaction and that from previous input, respectively.