The classic HMMs in particular have already been applied in detecting transliteration pairs from bilingual text.
we used the same parameter for staying in the X or Y state, another same parameter for moving from either X or Y to the end state, and the same parameter from the substitution state to the X or Y state.