The "inner loop" or base learner is a supervised learning algorithm.
yarowsky uses a simple decision list learner that considers rules of the form "If instance x contains feature f , then predict label j" and selects those rules whose precision on the training data is highest.