We trained the hyperparameters of the models on the validation set using Adam (Kingma and Ba, 2014).
we set the word embedding dimension to be 128, where the word embeddings are initialized randomly, and GRU dimension to be 256.