(2017a) found that word representations learned from the encoder are rich in morphological information, while representations learned from the decoder are significantly poorer.
the paper does not present a convincing explanation for this finding.