This is another form of doubly-recurrent neural networks.
using a doublyrecurrent architecture, specifically the surface decoder and the ancestor decoder, can improve perplexity scores for top-down word generation over the left-to-right decoder.