However, the training of log-linear neural language model is based on local word dependencies (e.g., the co-occurrence of the words in a local window).
paragraph Vector can not explicitly model the word dependencies for those words that do not frequently appear in a local window but are actually closely dependent on each other.