Although attention based model has the capability of jointly making alignment and translation, it does not take into consideration translation history.
a source word that has significantly contributed to the generation of target words in the past, should be assigned lower alignment probabilities, which may not be the case in attention based NMT.