We found that neural embeddings produced by current methods do not provide a suitable contextual similarity.
we define a new approach based on a Siamese Network, which produces word representations while learning a binary text similarity.