Therefore, we follow the recent trend in NLP of using transfer learning.
we experiment with pre-training models on related tasks that have larger datasets, and then fine-tuning them on our training data.