The neural network model takes (H t−1 , s t , u t ) as input, and predict H t as its output.
we use a logistic model to define the probability: The vectors w h , w u , w s are linear combination coefficients to be estimated.