Once enough data has been collected, we isolate 15, 000 comments in each language by the follow-  ing procedure: • Remove all duplicates.
this handles comments that might have been scraped twice or automatic comments from bots.