Since we would like to test the effectiveness of adding supervision, we treat all verbs in the evaluation set as unsupervised, with no initialization of θ.
to compare apples-to-apples, we calculate the nPU, niPU, and F1 of the Kawahara et al.