We show that this strategy is more effective than using pretrained emoji embeddings for tweet classification.
we obtain new state-of-the-art results in irony detection and sentiment analysis despite our neural network is simpler than previous proposals.