Unfortunately, when the learning task is semantically difficult such as in QA, e.g., features have to encode combinations of syntactic and semantic properties.
their extraction modules basically assume the shape of high-level rules, which are, in any case, essential to achieve state-of-the-art accuracy.