Since only one pair of (d, w) is being observed, as a result, the joint probability model is a mixture of log-linear model with the expression Typically, the number of documents and vocabulary size are much larger than the size of latent semantic class variables.
latent semantic class variables function as bottleneck variables to constrain word occurrences in documents.