Comparing encoder representations to decoder representations, it is interesting to see that in several cases the decoder side representations performed better than the encoder side ones, even though the former were trained using a uni-directional LSTM.
we trained and evaluated the semantic and the syntactic classifiers on existing annotated corpora.