Looking more closely at the results of our main method IncAgg, it is interesting to note that large improvements are obtained for depth-1 decision trees, which shows that our facet subspaces make it easier to identify features that correspond to the categories from the corresponding classification problems.
large improvements can also be seen for SVMs, which shows that the actual decomposition of the space is also helpful.