The choice of λ from {10 −5 , 10 −6 , 10 −7 } and the number of training iterations were very important for different training objectives and models in order to avoid overfitting.
they were determined by the performance on the development data for each different training objective and/or network configuration, e.g., the dimension for a hidden state.