Crowd-sourcing has been shown to be effective for language processing related tasks, e.g.
for SVM-based classification, the higher reported performance for also including POS features in addition to lexical n-grams could not be shown to be significant (p>0.4).