The intuition is that since the initial state is responsible for the translation of whole target sentence, it should at least contain information of each word in the target sentence.
due to the large amount of parameters and relatively small training data set, the end-toend learning of an NMT model may not be able to learn the best solution.