We have already seen for the previous ILP method, when using our bigrams together with the weights, better performance can be achieved.
we ask the question whether this is simply because we use supervised learning, or whether our proposed regression model is the key.