Compared the mean RAE with LSTM-SDAE, both of which use the RNN-RNN encoderdecoder network to reconstruct the input sequence, our mean RAE consistently obtains better performance than LSTM-SDAE across all considered tasks.
it yields a performance gain of 10.4 on the TREC dataset and 29 on the STS14 dataset.