Our word-level decoder (see Figure 4) differs from the standard sequential decoder described in § 2 in that it takes the chunk representations (c) k as input: In a standard sequential decoder, the hidden state iterates over the length of a target sentence and then generates an end-of-sentence token.
its hidden layers are required to memorize the long-term dependencies and orders in the target language.