The core of our model (head mixture) tends to cluster non-pronouns with the same head.
we initialized by setting all weights to zero, and running the same learning algorithm on the base MLN, while assuming that in the ground truth, nonpronouns are clustered by their heads.