And although a human judge could determine the optimal termination point based on several criteria such as clustering quality or the number of clusters, we used a development set instead for the sake of reproducibility and comparability.
we optimized θ min on the CoNLL test set and obtained best results with θ min = 1 3 .