However, because of potential differences in genre, topic and writing style, such negatives might cause the discriminative model to learn cues unrelated to coherence.
we only select sentences from the same document to construct negative pairs.