We also propose a method of incorporating tag dictionary information into our neural models by combining word representations with representations of the sets of possible tags.
finally, we obtain the output label y t by performing a softmax over the tag set vocabulary.