In this work, we use crowdsourcing to generate evaluation data to validate simple techniques designed to adapt a widely-used high-performing named entity recognition system to new domains.
retraining an NEr system for a particular domain can be expensive if new annotations must be generated from scratch.