Among those, the adversarial target input (z = z) shows the greatest decrease of 1.87 BLEU points, and removing language models have the least impact on the BLEU score.
language models are still important in reducing the size of the candidate set, regularizing word embeddings and generating fluent sentences.