By changing K to values between these two extremes, we can analyse the effect of the quality of the algorithmic expert on the trained policy; Figure 4 shows the results.
our trained policy can make better rankings of unlabelled datapoints in the pool, leading to more effective AL strategies.