(2017) have improved attention-based NMT by integrating a phrase memory, which stores target phrases provided by a statistical machine translation (SMT) (Pal et al., 2010) model, to perform a phrase-by-phrase translation rather than a word-by-word translation.
in Baseline Concat, the encoder generates a hidden state from the concatenated vector of the embedding vector for an input word and that for its NE tag at each time step (refer to Equation (9)).