Thus, the final dataset consists of pairs of message pairs ((p i , p j ), (p i , p k )), where they have the same reply message p i , and p j is the correct quote message of p i , but p k is not.
note that in this formulation, all words have an equal chance to affect the overall similarity between vectors since it is the angle represented by each word in a pair that comes to play when cosine distance is applied to a word pair.