Our LSTM processes one word at a timestamp.
given the word embedding sequence {x 1 , x 2 , ..., x n } for the essay, the hidden states of the LSTM are calculated as follows: the average value over all hidden states of each LSTM layer are computed, and we concatenate the mean states of the two layers together as the embedding vector of the essay.