We multiply the performance gap between ideal performance and current performance with the episode index, thus giving later failure greater penalty.
more illustrations about safety loss and efficiency loss are given in Appendix D. Our experiments have three objectives: (1) Comparing our proposed dropout DQN in Algorithm 1 with some baselines when there is no teacher.