Using the 300-D GloVe word embeddings was very helpful: LSTM-RNN performed on par with DRNN in the fine-grained task, and with CNN in the binary task.
taking into account both tasks, LSTM-RNN with the 300-D GloVe word embeddings outperformed all other models.