First, except for the largest minibatch size of 48, minibatch learning generally improves the accuracy  of the converged model, which is explained by our intuition that optimization with a larger constraint set could improve the margin.
the communication overhead and update time are not included.