Emerging research has begun to explore hyperparameter optimization methods, including random search (Bengio, 2012), and Bayesian optimization (Yogatama and Smith, 2015;Bergstra et al., 2013).
these sophisticated search methods still require knowing which hyperparameters are worth exploring to begin with (and reasonable ranges for each).