We have thus removed the queries which contained OOV words -resulting in a set of 96 queries -which clearly biases the evaluation.
the results on both the 1-best and the lattice indexes are equally favored by this.