When continuing to train on this dataset, we initialize the model with the parameters learned from PPDB, use the hyperparameters that maximize Pearson's r on the 2016 STS tasks and try dropout (Srivastava et al., 2014)  Results: In Table 1, we show the results of our model when trained on PPDB XL only.
this set of results is the median of five runs with random initialisations of the learnable parameters.