And it is collected accumulatively following a diagnostic procedure in clinic, which involves interactions between patients and doctors and some complicated medical tests.
when training the policy, we use a technique known as experience replay.