As tweets are noisy texts, a pre-processing phase has been applied to improve the quality of linguistic features observable and reduce data sparseness.
a normalization step is applied to each post: fully capitalized words are converted in lowercase; reply marks are replaced with the pseudo-token USER, hyperlinks by LINK, hashtags by HASHTAG and emoticons by special tokens 5 .