RNNs encode, to some extent, structural information by recursive semantic composition along a parse tree.
they may have difficulties in learning deep dependencies because of long propagation paths (Erhan et al., 2009).