Van den Bosch 2005proposes a decision-tree classifier which has been applied to training datasets with more than 100M words.
his model is non-probabilistic and thus a standard comparison with probabilistic models in terms of perplexity isn't possible.