Empirically, for non-convex objectives, different approaches may arrive at different solutions.
for convex loss functions, our objective (Equation 2) is also convex, and all approaches should share the same solution.