As shown in the left plot of Figure 4, the gradients of the "x + F" structure are basically the same, indicating that all the residual blocks have similar speed for gradient descent and optimization.
the right plot of Figure 4 reflects that more gradients are allocated to the lower blocks with the help of SAS, and the overall gradient values are greater.