(3) as a regularization term, where λ P DR is a positive weighting coefficient, to construct the following new loss function for the language model.
equivalently PDR can also be viewed as a method of defining an augmented loss function for language modeling.