The plot shows that there exits a unique minimum and both constraints contribute to achieve a better likelihood compared to their unregularized counterparts (for which λ 1 = λ 2 = 0).
the regularization imposed by the differential of context and target embeddings g 2 contributes more than the regularization on the em-beddings Ψ and Φ separately.