Para2Vec utilizes word and document coherence to learn their embeddings.
hierarchical Document Vector (hDV) (Djuric et al., 2015) leverages both streaming documents and their contents to achieve better representation, which is similar to our proposed model.