Experimental results of language modeling are evaluated by the reconstruction loss using perplexity and the targeted syntactic evaluation proposed in (Marvin and Linzen, 2018).
unsupervised paraphrasing can be performed using both SIVAE-c and SIVAE-i.