As shown in Figure 1, VGVAE assumes a sentence is generated by conditioning on two independent variables: semantic variable y and syntactic variable z.
our model gives rise to the following joint likelihood where x t is the tth word of x, T is the sentence length, and p(x t |y, z) is given by a softmax over a vocabulary of size V .