In light of these observations, we also conjecture that a more reduced, but diverse and manually annotated, corpus might be more effective.
a manually checked corpus distilled by inspecting click patterns across query logs of search engines.