With treebank data such as Penn Treebank (Marcus et al., 1993), we have pairs of (x, y) to train the two components respectively, and get high-quality language model with the parser providing grammar knowledge.
due to the expensive cost of accurate parsing annotation, Figure 1: Overall framework of neural variational language model (NVLM).