An asynchronous framework may use multiple processors more efficiently and minimize idle time (Nedic et al., 2001;Langford et al., 2009).
in this setting, the master sends θ and a mini-batch M k to each slave k. Once slave k finishes processing its mini-batch and returns g M k (θ), the master immediately updates θ and sends a new mini-batch and the new θ to the now-available slave k. slaves stay occupied and never need to wait on others to finish.