We combine the supervised and CVT losses into the total loss, L = L sup + L CVT , and minimize it with stochastic gradient descent.
we alternate minimizing L sup over a minibatch of labeled examples and minimizing L CVT over a minibatch of unlabeled examples.