Although we are primarily interested in learning µ m , we must also learn σ 2 m in order to make confidence guarantees about the optimality of our selected model.
as well as keeping track of the sample means for the evaluations of each modelμ m , we also keep track of the sample variancesŜ m and counters T m of the number of times each model has been evaluated.