One could also use tree-based composition method such as Recursive Neural Tensor Network (Socher et al., 2013b) or Tree-Structured LSTM (Tai et al., 2015;Zhu et al., 2015) as alternatives.
we try CNN with multiple convolutional filters of different widths (Tang et al., 2015) to produce sentence representation.