Our implementations are based on the PyTorch 0.3.1 5 , and all experiments are conducted on the CoNLL03 dataset with the Nvidia GTX 1080 GPU.
due to the limited size of CoNLL03 test set, we measure such speeds on the training set.