LUSTRE effectively integrates this feedback to avoid over-estimating the reliability of learned rules, thereby improving the quality of model M .
it updates the reliability of a mapping rule P i r S as a function of number of incorrect predictions m r for the rule in the set of 10 predictions presented to the user (Line 20 of Algorithm 1).