Another main difference is that many active learning algorithms use a fixed data selection heuristic, such as uncertainty sampling (Settles and Craven, 2008;Stratos and Collins, 2015;Zhang et al., 2016).
in our algorithm, we implicitly use uncertainty information as one kind of observations to the RL agent.