It would seem that rare lexical items are indeed crucial for SVM classification performance.
in Goldberg and Elhadad (2007), we suggested that the SVM learner is using the rare lexical features for singling out hard cases rather than for learning meaningful generalizations.