Both Della Pietra, Della Pietra, and Lafferty (1997) and McCallum (2003) describe methods that induce conjunctions of ''base'' features, in a way similar to decision tree learners.
a relatively small number of base features can lead to a very large number of possible conjoined features.