The decoders in the above studies can model the chunk structure by storing chunk pairs in a large table.
we do that by individually training a chunk generation model and a word prediction model with two RNNs.