To find which of these two hypotheses is responsible for the performance gain, the presence bits kernel was computed on the raw text documents using a range of 5-8 p-grams.
preliminary results showed that trying to fit more of the training data leads to lower accuracy rates (not more than 1-2 percentage points, though) in the CV procedure.