Due to the limited amount of training data, models are more likely to suffer from over-fitting.
we use a higher dropout rate of 0.2 and weight decay, another common technique against overfitting, with decay weight set as 10 −3 as the default setting.