Since POS is a strong predictor of predicates 4 and the complexity of training a multi-task model increases with the number of tasks, we combine POS tagging and predicate detection into a joint label space: For each POS tag TAG which is observed co-occurring with a predicate, we add a label of the form TAG:PREDICATE.
we feed the representation s (r) t from a layer r preceding the syntacticallyinformed layer p to a linear classifier to produce per-class scores r t for token t. We compute locally-normalized probabilities using the softmax function: is a label in the joint space.