During adaptation the model performs a single parameter update after each sentence and does not train until convergence with gradual reduction of the learning rate as would normally be the case during LM training.
the learning 5 For additional details as well as the reverse setting (adaptation to PO), see Supplementary Materials.