Our intuition was that a decision tree makes a categorical decision at each node in the tree, hence it could capture the binary-switch like behavior of features.
the performance of the decision tree is found to be statistically indistinguishable from the linear SVM as shown in entry 4 of table 5.