Regarding reproducibility in NLP, a cross-cutting analysis of papers presented at the EMNLP 4 2018 conference (Dodge et al., 2019) showed a widespread, positive practice of reporting the best hyperparameter settings (74%) and the data splits used (92%).
only 8% of the papers describe the hyperparameter search bounds, 14% the search strategy, and only 30% provide the source code.