(2017) studied the problem of spurious programs and considered adding noise to diversify the search procedure and introduced meritocratic updates.
rEINFOrCE and maximum margin reward both have a non-zero intensity only on a single program in K. This value is 1.0 for maximum margin reward, while for reinforcement learning, this value is the reward.