This categorized lexicon is quite similar to word cluster features in (Ratinov and Roth, 2009), but is more precise.
aDF and MaDF are consistently faster than plain SGD and often reach reasonably good performance after a mere 10 passes over the datasets.