We create sentence vectors s i for all sentences s i with the attention-based bi-LSTMs.
similar to traditional models, they also compress sentence vectors into a single fixed-length vector via average pooling.