As an alternative, we used an SVM with a quadratic kernel, since it can also capture such pairwise interactions of features.
we consider each labeled feature as a propositional variable, where true or false corresponds to whether the label of the feature is positive or negative respectively.