Learning and planning are accomplished every C steps reset θ Q = θQ 43: end for by the same DQN algorithm, operating on real experience in D u for learning and on simulated experience in D s for planning.
here we only describe the way the simulated experience is generated.