RNN and NN both have 100% coverage on the Wikipedia data.
the following recurrence 2 is used to compute the activations of the hidden state at word position t: where f is a non-linear activation function; here we use the sigmoid function f (z) = 1 1+e −z .