The SemeEval task description paper (Laparra et al., 2018b) has more details on dataset statistics and evaluation metrics.
there is a need to study pre-trained contextualized character embeddings, to see if they also yield improvements, and if so, to analyze where those benefits are coming from.