Despite the popularity of the sentiment task, the problem of developing comprehensive, yet easy to follow and "light" guidelines that would ensure high enough agreement is far from being solved.
we prioritized the speed of annotation over detail, opting for a 3-point scale rather than e.g., the 5point scale in SemEval Twitter datasets (Rosenthal et al., 2017).