The disadvantage of iterative parameter mixing, relative to simple parameter mixing, is that the amount of information sent across the network will increase.
if network latency is a bottleneck, this can become problematic.