In (Lee, You, and Li, 2008), we explored the use of acoustically-defined units, instead of the linguistically-defined phones, in characterizing speech utterances and spoken languages.
we train an ensemble of acoustic sound classes in a self-organized manner, each modeled with a Gaussian distribution, to form a speech sound inventory analogous to the phone inventory.