Attention is applied on left and right contexts, respectively.
the representation of the left context is: and the representation of the right context is: Together with the vanilla representation s, the distribution of sentiment labels is predicted by: A second extension is to add gates to control the flow of context information (BILSTM-ATT-G).