The hyper-parameters of the DNN, including the number and size of the layers, have been set-up empirically with a few trials and errors  on the training and validation corpus.
we have not used any automatic hyper-parameter tuning strategy.