Respectively, the policy model is trained via real experiences collected by interacting with real users (direct reinforcement learning), and simulated experiences collected by interacting with the learned world model (planning or indirect reinforcement learning).
the effectiveness of DDQ depends upon the quality of simulated experiences used in planning.