For CoNLL-2003, we found that particle swarm produced better hyper-parameters than random search.
surprisingly for OntoNotes particle swarm was unable to produce better hyperparameters than those from the ad-hoc approach in round 1.