Policy Shaping vs Model Shaping Critique policy contains useful information that can bias the search away from spurious programs.
this supports our hypothesis that aggressive updates of margin based methods is beneficial when the search method is more accurate as compared to maximum marginal likelihood which hedges its bet between all programs that evaluate to the right answer.