Since our implementation performs the un-rolling only at the end of each sentence, the updates would not have any effect.
we attach the document vector directly to the output layer, in parallel with the recurrent hidden component.