For 7 fruits PHC-W appears to perform worse than Q-learning but this is because, as we can see in Figure 5, in this case more than 400,000 episodes per epoch are required for convergence.
after only 100,000 episodes per epoch all policies still behave somewhat randomly.