Thus it is well-suited to learning NLG systems where measures such as BLEU (Papineni et al., 2002) or ROUGE (Lin, 2004) that do not decompose over single words are commonly used for evaluation.
we are able to learn the interactions of the word currently being predicted with those to be predicted later in the sentence.