The major issue in porting the memoriless transducer over to our task of transliteration extraction is that its training is supervised.
it would require a relatively large set of known transliterations for training, and this is exactly what we would like the model to acquire.