(2003) assess the computational complexity for standard gradient-based optimization with the full feature set by ≈ cmp 2 τ , for a multiple c of p line minimizations for p derivatives over m data points, each of which has cost τ .
for grafting, the cost is assessed by adding up the costs for feature testing and optimization for s grafting steps as ≈ (msp+ 1 3 cms 3 )τ .