As expected, performance degrades as we increase batch size, with batches of four allowing more fine grained control over model evaluations than using batches of eight.
due to the exploitative nature of Thompson sampling, we see that selecting models to a very high confidence (95%) requires more computation with BTS than the standard non-adaptive approach.