This strategy is guaranteed to work, since it can accelerate the computation of gradients, which is the substance of the backward propagation.
there is still a big concern: once the baseline models are simplified, will their performance be compromised?