In the process of exploring common technologies for tokenization and morphological analysis we also evaluated the processes to generate models for under-resourced languages that would enable us to increase the quantity of corpora.
in addition to the audio material and speech corpora, we developed Finite State Tools using the Foma toolkit and libraries (Hulden, 2009).