Since we propose a jointmodel, we cannot directly apply their pretraining trick on entities separately.
we use the same data splits as Li and Ji (2014) and Miwa and Bansal (2016) such that there are 351 documents for training, 80 for development and the remaining 80 documents for the test set.