As mentioned in the introduction, training the encoder using only this synonym-based objective will lead to biased representations.
the encoder will be trained to act like a hash function, which performs well on determining whether two names are synonym of each other.