The research community has been using methods such as word error rate, EER, precision and recall and its many variants as metrics to evaluate systems.
due to homonyms and phone-set differences across multiple languages, word error rate is not always sufficient to distinguish transliteration accuracy.