All weights of the RNN except biases are denoted by ω, while a single weight (an element of any weight matrix) is denoted by w ij .
for both datasets, we use the vocabulary of 20,000 most frequent words.