The advantage of this method is that memory intensive operations, such as attention and the copy mechanism, only need to be unrolled for K steps, and K can be adjusted so that the computation graph fits in memory.
these operations generally involve an exponential number of matrix multiplications as the size of c and z grows.