Neural sequence-tosequence models with soft attention, which are non-monotonic, often outperform popular monotonic models.
if we look at the data in grapheme-to-phoneme conversion, named-entity transliteration, and morphological inflection-examples are shown in Fig.