While optimising the hyperparameters for each dataset separately would likely improve individual performance, we conduct more controlled experiments on a task-independent model.
we use the same hyperparameters from Section 6 on all datasets, and the development set is only used for the stopping condition.