In this work, in order to control the updates in detail to keep a balance, we modify (4) to use a a step counter τ r for each relation r, counting "number of updates" instead of data points 2 .
whenever M r gets a nonzero update from a gradient calculation, τ r increases by 1.