Gaussians of variance 1/d to initialize parameters, so the initial Euclidean norms are and BAm r ≈ √ dc.
by calculating ∇L 1 and ∇L 2 using (1) and (3), we have approximately It suggests that, because of the scaling factor 1 √ dc in (3), we have ∆ 1 and ∆ 2 at the same scale, so we can set λ 1 = λ 2 .