Several other related systems work directly from the acoustic signal and many of these do use naturalistic corpora.
in both cases modeling variability improves the accuracy of the learned lexicon over a system that assumes each lexical item has a unique pronunciation.