µ Y |X = E 1 (X) and µ Z|X = E 2 (X).
p(X|Y, Z) is the probability of observing the sentence X given Y and Z, which is modelled by a decoder network D. the reconstruction loss can be rewritten as: where H is the cross entropy loss for the decoder.