As there are hundreds of millions of parameters in the NMT system, it is hard for the model to learn the exact representation of source sentences.
the values of initial state may not be exact during the translation process, leading to poor translation performances.