However, when the model is close to the maximum, the approximation becomes unstable, which is not surprising since it is based on feature independence assumptions that become invalid as the weights of interaction features move away from zero.
we disable the preconditioner after a certain number of iterations, determined from held-out data.