The ap-proximated diagonal term H f for feature f has the form If this approximation is semidefinite, which is trivial to check, its inverse is an excellent preconditioner for early iterations of CG training.
when the model is close to the maximum, the approximation becomes unstable, which is not surprising since it is based on feature independence assumptions that become invalid as the weights of interaction features move away from zero.