More recently, augmenting this neural architecture with the attention mechanism Luong et al., 2015) has dramatically increased the quality of results across most NLP tasks.
in text normalization, state-of-the-art results involving attention (e.g., Xie et al.