There has been a great deal of work on using variational autoencoders in semi-supervised settings Maale et al., 2016;Zhou and Neubig, 2017;Yang et al., 2017b).
since the z variable is used to both predict the tag and reconstruct the word, it must capture both the tag and word reconstruction spaces, and may be limited by capacity in doing so.