Recent advances in sequence modeling have highlighted the strengths of the transformer architecture, especially in achieving state-of-theart machine translation results.
depending on the upstream systems, e.g., speech recognition, or word segmentation, the input to translation system can vary greatly.