At each token t and for each gold label at the previous step g k t−1 , our network takes the hidden representation from the previous layer z from the previous time step, and computes: Unlike the encoder LSTM, this decoder LSTM is single-directional and bifurcates when multiple gold labels are present.
gold-standard annotations are shown in red.