It is worth noting that our deep encoder is different from the one of Marcheggiani and Titov 2017, which directly applies a softmax transformation over the syntactic representation and predicts the role label for each word.
their syntactic encoder outputs are directly taken as the input of hidden layer.