Furthermore, both AE-LSTM and ATAE-LSTM perform better than LSTM model, because they all consider the importance of the aspect term, and utilize the attention mechanism.
aTaE-LSTM outperforms aE-LSTM since it appends the aspect embedding to each word embedding and takes them as inputs, which helps the model obtain more semantic information related to aspect term.