(2008) propose PostCAT which uses Posterior Regularization (Ganchev et al., 2010) to enforce posterior agreement between the two models.
the only extra work is in the Mstep, which optimizes a single (concave) objective function.