Note that this update is performed only when φ(S c ) • w k − C < φ(S * ) • w k for all S c ∈ S c since otherwise S * in the learning algorithm cannot be a state with an incorrect first action.
φ(S c ) • w − φ(S * ) • w ≥ C for all S c ∈ S c after convergence.