The regularized MLE for the binary classifiers satisfies Notice the right hand sides of (4) and (7) are the same.
taking P (w|h) = P b (w|h) from ML trained binary classifiers gives an LM that meets the MLE constraints for language models.