To this end, we remove listings corresponding to such "out-of-category" merchants from all top-level categories.
by manually inspecting K × 6 most probable words from the K=100 topics and J × 100 listings, where J << K, instead of 3.4 million, a few annotators accomplished in hours what would have taken hundreds of annotators several months according to the estimates in Sun et al.