In theory, the summation in the denominator of Equation 1 should range over all possible sentences S, which is not feasible in practice.
we replace the set S with the union of the set S + of sentences that occur next to the sentence s i in the training data, and S − , a set of n randomly chosen sentences that are not observed next to the sentence s i in the training data.