Bidirectional LSTMs (Graves and Schmidhuber, 2005) have been shown to learn improved representations of sequences by encoding a sequence from left to right and from right to left.
table 7 further lists baselines reported by Mohammad et al.