While the general RNNLM is a smooth static representation of the entire training data, the document vector is optimised to represent how each sentence differs from the main language model.
we performed a qualitative evaluation and found that the learned sentence vectors were also very good predictors of semantic similarity.