To get an upper bound on performance of any disambiguation technique, we manually disambiguated the Trec5C-medium, Trec6Cmedium and Trec4S queries.
for each English query term, a native Chinese or Spanish speaker scanned the list of translations in the bilingual lexicon and kept one translation deemed to be the best for the English term and discarded the rest.