Le and Zuidema (2016) have shown that, for deep and complex hierarchical structures, the models that have a memory akin to the memory in LSTM are much more robust towards the vanishing gradient problem.
in our work we use the Tree-LSTM neural architecture from Tai et al.