We also add some of the recent enhancements to DQN (Hessel et al., 2017), which have proved to be useful in our setup.
we implement Double Q-Learning (van Hasselt et al., 2016), Prioritized Experienced Replay (Schaul et al., 2015), and Dueling Networks .