training on multiple datasets has shown promising results (Collobert and Weston, 2008).
we only save a single tweet for the pretraining per unique emoji type regardless of the number of emojis associated with the tweet.