For each token in the sequence, we perform a softmax over all candidate tags to output the most likely tag: Our network structure as shown in Figure 2 also contains connections from the output y t−1 of the previous time step to the current top hidden layer.
our outputs are not conditionally independent from each other.