Decay-hard sampling: to imitate the behavior that human gradually increase the difficulty of their learning materials at different stages, we propose a decay-hard sampling strategy which decays the margin in Equation (4) with the training process going on.
we consider two methods, namely exponential decay and linear decay.