(2018), we also observe some variance in model performance even if training is carried out with the same random seed, which is largely due to the non-deterministic ordering of floating-point operations in our environment (Tensorflow (Abadi et al., 2015) with a single GPU).
to account for the randomness, we further train our model 5 times for each random seed and select the model with the best validation performance.