Each h N i is produced by iterating the following equations (without the subscript i): where r t is the reset gate, z t is the update gate, h t is the proposed update state at time t and denotes a component-wise product.
the decoder is a language model that is conditioned on the distributed representation and, in Sent2Vec, is used to "predict" the sentences surrounding the input sentence.