Our proposal is based on the intuition that a feature with higher frequency in the training process should be with a learning rate that decays faster.
we assume a high frequency feature observed in the training process should have a small learning rate, and a low frequency feature should have a relatively larger learning rate in the training.