Importance of Fine-tuning in RNNs: Finally, in order to show the importance of fine-tuning the word embeddings in RNNs on our task, we present in Table 5 the performance of Elman and Jordan RNNs, when the embeddings are used as they are ('-tune'), and when they are fine-tuned ('+tune') on the task.
we also present an architecture to incorporate other linguistic features into RNNs.