Following the same methodology as Section 3.4.2, we evaluated 300 random predictions using the Mechanical Turk service.
to quickly build an English-language filter for twitter, we sampled 150,000 tweets from the twitter Streaming API and asked an annotator spend 10 minutes with DUALISt labeling English and non-English messages and features.