Under certain circumstances, crowd-sourcing can be very effective for handling large tasks requiring human intelligence without relying on expensive experts.
to using expert annotators, crowd-workers are readily and cheaply available even for ad-hoc tasks.