The middle-left part of Figure 3 depicts the biL-STM and its final output, the average vectors a.
to LSTMs, which are designed to capture the meaning of sequences, Convolutional Neural Networks (CNNs) are often used to pro- duce bag-of-words-like representations.