Unfortunately, CD training cannot infer this structure since the CD derivation makes use of a fixed structure in the one-step reconstruction.
we have taken a MCEM approach, first sampling the PoE structure in the E-step, then fixing these samples for Z and B when computing the one-step reconstruction of the data, X. Contrastive Divergence Gradient We provide the approximate derivative of the contrastive divergence objective, where Z and B are treated as fixed.