Several important adjustments should be made to our algorithm to account for peculiarities of this set-up.
(a) the OntoNotes guidelines do not provide annotations for singleton entities and (b) the official shared task score (MELA) relies strongly on B 3 and CEAF metrics.