In contrast, RANDOMER spreads probability mass over multiple rewardearning programs, including the correct ones.
of overfitting, we observed at test time that BS-MML only references people by positional indices instead of by shirt or hat color, whereas RANDOMER successfully learns to use multiple reference strategies.