We leverage an extended version of LSTMs (Hochreiter and Schmidhuber, 1997) as our base model in Figure  3, which overcomes the gradient vanishing of existing RNNs.
attention-based bidirectional LSTMs (Att-BLSTMs) (Zhou et al., 2016) are mostly used in sentence modeling.