Since there are four categories for AG's News, the classification accuracy of workers on this dataset is significantly lower than that on IMDB (binary classification tasks).
we did not try human evaluation on Yahoo!