We propose a mean-max attention autoencoder (mean-max AAE) to model sentence representations.
an encoder performs the MultiHead self-attention on an input sentence, and then the combined mean-max pooling operation is employed to produce the latent representation of the sentence.