(2016) have shown that a simple but supervised word averaging model of sentence embeddings leads to better performance on the paraphrase pairs data set (PPDB).
the performance of their approach is closely related to the supervision from the date set, while without supervision, their approach did not perform well on textual similarity tasks.