A promising way of overcoming this weakness is to include n-grams, generalizing the bag-ofwords model into a bag-of-phrases model (Baccianella et al., 2009;Pang and Lee, 2008).
regression models over the feature space of all n-grams (for either fixed maximal n or variable-length phrases) are computationally expensive in their training phase.