The marginalization process is performed by appealing to the conjugacy between multinomial language models and the Dirichlet prior.
in the Biography dataset, we can see that using the dynamic LMP instead of the independent improves the the Beta-Bernoulli and Gamma-Poisson results by 0.01 and 0.09, respectively.