has the highest expected reward) is: where Θ a is the set of those parameter values under which the arm a would be selected as the optimal arm: In Thompson Sampling the next arm to pull is sampled according to the posterior probability of the arm being optimal.
an arm a is selected with probability α T,a .