For each batch B A and each batch B R , we construct batches of corresponding negative pairs T A (B A ) and T R (B R ), containing new pairs of words sampled among those present in the batch of positive pairs.
half of the negative examples t l and t r for ATTRACT (or RE-PEL) pairs are chosen by retrieving the nearest (or farthest) neighbours to x l and x r , respectively, in terms of cosine similarity.