Our baselines are a simple word averaging (WORDAVG) model and bidirectional LSTM averaging (BLSTMAVG) model, both of which have been shown to be very competitive for modeling semantic similarity when trained on paraphrases .
wORDAVG takes the average over the word embeddings in the input sequence to obtain the sentence representation.