Twitter messages were manually labelled by assigning a positive/negative class to all messages that unequivocally expressed a stance on the intended topic, and by assigning the class 'other' to any message that did not meet these criteria.
the class 'other' represents the fact that, despite containing a key word of interest, the message did not convey any obvious stance about the target topic, and it was therefore regarded as noise 1 .