Because the task utilizes millions of features and training samples, directly optimizing the penalized lasso loss function is impossible.
two approximation methods, the boosted lasso (BLasso, Zhao and Yu 2004) and the forward stagewise linear regression (FSLR, Hastie et al.