dropout can be observed as claimed in (Gal and Ghahramani, 2016).
dropout dQN 1 seems to suffer premature and sub-optimal convergence, while our proposed dropout dQN 32, whose decision is based on multi votes (algorithm 1), can result in improvement of efficiency and better final performance.