To insert only true positive pairs in M ours , we set threshold higher than the optimized value from the step 4.
we found out that symmetry from M ours closely estimates that from M : observe from Table 1 that, given a manually built ground-truth set M g ⊂ M as described in Section 4.1, S(G e , G c ; M ours ) returns the best symmetry value in two weeks for person entities, which is expectedly the same as the result of S(G e , G c ; M g ).