In general, tree structure works better than chain structure to model long term information.
we use gated recursive neural network (GRNN) (Chen et al., 2015) which is a kind of tree structure to capture long distance dependencies.