Using the augmented training set, consisting of both the original documents and the additional pseudodocuments, we can then employ any existing PV model (Le and Mikolov, 2014;Dai et al., 2015) to learn the document-phrase co-embeddings.
due to the significant differences in the sizes and numbers of documents and pseudodocuments, there is a danger that the addition of the pseudo-documents can have a detrimental effect on the performance of the model.