Language-model (LM) Bridge The LM bridge utilizes a pretrained neural language model p LM (Y ) as constraint, which motivates to propose target examples conforming to language fluency.
similar to the uniform bridge case, we can re-write the loss function to a KL-divergence: the LM bridge is also static and can be seen as an extension of the uniform bridge, where the exponentiated similarity score is re-weighted by a pretrained LM score, and renormalized: where Z is the partition function.