One potential issue is that the Enc-Dec needs to be able to compress all the necessary information of the input source sentence into context vectors which are fixed during decoding.
a natural question was raised, Will carefully designed aggregation operations help the Enc-Dec paradigm to achieve the best performance?