To simplify optimization 6 we take an approach inspired by the posterior regularization method (Ganchev et al., 2010) and use the objective: (4) The above objective will attain lower values for A such that p T (c 1 , c 2 ; A) is close to the constraint set.
it will have a value of zero when the bigram distribution induced by A has the property specified in S pre .