We study the influence of attention on both S-LSTM and BiLSTM for classification.
additive attention (Bahdanau Dataset Training Development Test #sent #words #sent #words #sent #words Movie review (Pang and Lee, 2008)  Here W α , u and b α are model parameters.