Q-learning failed to converge in all cases, except for very small state space sizes.
both PHC and PHC-WoLF always converged (or in the case of 7 fruits they needed more training episodes) and performed similarly.