Our findings support the observations of Cumby and Roth 2003, who point out that kernels introduce a large number of irrelevant features that may be especially harmful in small-data settings, and that, when possible, it is often better to have a set of explicit, relevant features.
it is better to have the right features than all of them.