Given the tuple (s i−1 , s i , s i+1 ), the objective is to optimize the sum of the logprobabilities of the next (s i+1 ) and previous (s i−1 ) sentences given the distributed representation (h N i ) of s i : where the total objective is summed over all training tuples ( The utility of Sent2Vec is that it is possible to infer properties of the surrounding context only from the input sentence.
we can assume that the Sent2Vec distributed representation is also carrying information regarding its context (without the need to explicitly access it).