In this paper, we present a global context enhanced deep transition architecture to eliminate the mentioned limitations of BiLSTMs.
we base our network on the deep transition (DT) RNN (Pascanu et al., 2014), which increases the transition depth between consecutive hidden states for richer representations.