4) We also observe that because of the smaller data size, we need a decayed learning rate λ in order to stablize the models' training.
we set the initial λ 0 = 1.1, and decrease it for each epoch T > 1 as λ T = λ 0 /T .