In a sense this is counter-intuitive, since p θ is being trained to unlearn bias, while p φ,θ is being trained to learn it.
if the models are trained separately, they may learn to co-adapt with each other (Elazar & Goldberg, 2018).