This result is not unreasonable, however, because, due to limited time, very little effort was spent tuning the parameters of the model.
while the syntactic pattern based reranker increases performance using human annotations by nearly 2%, the effect when using automatically extracted information is only 0.5%.