In this paper, we propose a new type of decoder for NMT, which splits the decode state into two parts and updates them in two different timescales.
we first predict a chunk timescale state for phrasal modeling, on top of which multiple word timescale states are generated.