q k to be log probabilities under the generative model: We modify this definition slightly, be introducing scaling factors c j,a > 0, and defining In our experiments, c j,a is simply a count of the number of times the feature indexed by (j, a) appears in unlabeled data.
more frequent features have their contribution down-weighted in the model.