Thus it is natural to take attributespecific vocabulary memory A into consideration when predicting output vocabulary distribution and different words in A may have different effects.
we utilize an attention mechanism to extract important words in A when obtaining vocabulary state m t .