To directly handle the problem of discriminative learning when labeled data is scarce, (Ororbia II et al., 2015) proposed deep hybrid architectures that could effectively leverage small amounts of labeled and large amounts of unlabeled data.
the best-performing architecture was the Stacked Boltzmann Experts Network (SBEN), which is a variant of the DBN.