Denote the subset of parameters that are unlexicalized by θ ( ) .
our coarse-grained, universal PoS tag set consists of the following 12 tags: NoUN, VERB, ADJ (adjective), ADV (adverb), PRoN (pronoun), DET (determiner), ADP (preposition or postposition), NUM (numeral), CoNJ (conjunction), PRT (particle), PUNC (punctuation mark) and X (a catch-all for other categories such as abbreviations or foreign words).