The parameters w of Q(s, a) are learned based on feedback from the roll-out simulations.
since our model is a non-linear approximation of the underlying action-value function of the game, we learn model parameters by applying non-linear regression to the observed final utilities from the simulated roll-outs.