Banko and Brill (2001) report on confusion set disambiguation experiments where they apply relatively simple learning methods to a one billion word training corpus.
having access to very large corpora ought to reduce the need for smoothing, and so ought to allow us to design simpler systems.