This is a reasonable approach, under the assumption that we are modeling a single underlying distribution in the data.
in many applications and for many natural language datasets, there exist multiple underlying distributions, characterizing a variety of language styles.