This strategy for computing the gradient ∂goal/∂a via the chain rule is an example of automatic differentiation in the reverse mode (Griewank and Corliss, 1991), known in the neural network community as back-propagation.
what if goal might be computed only approximately, by early stopping before convergence ( §4.5)?