With the exception of MIRA, the tuning approaches discussed in this paper are direct optimizers.
each solves the following optimization problem: where the first term provides regularization, weighted by λ.