In practice, we solve the problem above by maximizing the first term with gradient-based optimization and early-stopping after only a few update steps.
in the low-resource scenario, finding a good initialization ✓ 0 strongly correlates the final performance of the resulting model.