To improve the stability of online variational inference, we use a mini-batch of documents to compute the natural gradients.
the contribution of the single document d in (4) is replaced by sum of contributions of documents in the minibatch S, and the factor D is replaced by D/|S|.