Inspired by the work of Bohnet and Nivre (2012), we embed the set of top tags according to a first-stage tagger.
we define the feature group ktags as the matrix X ktags such that, for where P(POS = v | f ) is the marginal probability that the token indexed by f has the tag indexed by v, according to the first-stage tagger.