To learn word embeddings which capture the similarity between a triple and a set of paraphrases (rather than just the similarity between a triple and artificially synthesised sentences), we multitask the training of our model with the task of paraphrase detection.
the weights of the W matrix for words are learnt with the training of the triple/sentence similarity function S t/s and the training of a similarity function S p for paraphrases which uses the same embedding matrix W for words and is trained on P, the paraphrase corpus.