In this paper we explore generalized pooling methods to enhance sentence embedding.
by extending scalar self-attention models such as those proposed in , we propose vectorbased multi-head attention, which includes the widely used max pooling, mean pooling, and scalar selfattention itself as special cases.