Learning-rate schedule and early-stopping -The code base did not include an implementation of the learning-rate schedule that was reported to be used in the original experiments.
the exact configuration of the baseline is not discussed in the paper, however, the authors do share that they implement both layer-normalization and the output module.