This criticism motivates our chosen algorithm TTTS (summarised in Algorithm 2), where instead of sampling a single model according to π, we sample two distinct models.
in addition, this approach extends to the asynchronous setting, where rather than waiting for the whole batch of B models to be evaluated before choosing the next batch, each worker can draw a new model to evaluate according to the updated π.