Further problems arise in the AL scenario where the instances to be annotated are selected as a function of the sampling method and the annotation judgements made before.
beigman and Klebanov beigman (2009)'s approach of identifying unreliably annotated instances by disagreement is not applicable to AL, as most instances are annotated only once.