Here, we use tanh(a) = (e a − e −a )/(e a + e −a ) for function s since it is fast when training the parameters.
the prediction is then obtained by applying: where W 2 is the weight matrix connecting the hidden layer to the output layer and b 2 is a bias vector for the classifier.