During the decoding, only the already generated target words are available.
either all 2DLSTM states have to be recomputed, or it has to be extended by an additional row at every time step i that cause higher complexity.