As RNNs are not good at remembering the old history and cannot consider word relationship either, sometimes conventional NMT cannot get enough source information and hence emphasizes too much on the fluency of the target.
it suffers from meaning-drift and generates "inaccurate" translation.