One interpretation of this argument applied to textual data is that factorizing the joint probability as p(x) = t p(x t |x <t ) provides the model with a sufficiently powerful decoder that does not need the latent variables.
our experimental results suggest that LSTM encoder may not be a sufficiently expressive encoder for VAEs for textual data, potentially making the argument inapplicable.