To train the GAN, we used the distributed sentence representations computed from the pretrained sentence embeddings instead of symbolic sentences.
we think the limitation of the pre-trained sentence embeddings can be overcome by building a GAN that generates symbolic sentences and discriminates them.