Some approaches started to enrich the text representation by exploiting its semantic meaning by using the Latent Semantic Analysis (LSA) (Choi et al., 2001).
these approaches require a very large corpus, and consequently the pre-processing effort required is significant.