In order to allow a fair comparison, we trained the word-based model on the same corpus as the dependency-based model (the complete BNC) and selected parameters that have been considered "optimal" in the literature (Patel, Bullinaria, and Levy 1998;Lowe and McDonald 2000;McDonald 2000).
we built a word-based model with a symmetric 10 word window as context and the most frequent 500 content words from the BNC as dimensions.