One complicating issue has to do with the tokenization in the Penn Treebank versus that in the HUB1 lattices.
interpolation with a trigram model yields an exceptional improvement relative to the improvement observed by other models, demonstrating the degree to which the information captured by our parsing model is orthogonal to that captured by a trigram model.