(2010), the inside-outside algorithm dominates the runtime of every iteration, both for sampling and variational inference.
unlike MCMC, variational inference is highly parallelizable and requires fewer synchronizations per iteration (Zhai et al., 2012).