Our model identifies semantically-relevant parts of documents and locally integrates their representations through clustering and autoencoding.
to averaging, our model prevents larger semantically-relevant parts of inputs to dominate final representations.