However, even small differences on those aspects between two sentences can lead to a different classification result.
we train (using the MSPRC training data) an additional logistic regression classifier which is based not only on the embeddings similarity, but also on a few handengineered features.