Furthermore, we analyzed the advantages and disadvantages of our model, and found that it is better at capturing semantic similarity of two sentences than averaging models, especially when they have little word overlap but similar meanings.
it tends to overestimate the low semantic similarity of a sentence pair.