In practice we may wish to modify the regression step in an attempt to learn a better transformation matrix A.
the standard first approach of using 2 -regularized (Ridge) regression instead of simple linear regression gives little benefit, even when we have more parameters than word embeddings (i.e.