The fine-tuning is then done as in ProposedRU.
to the above single-step pre-training, we also attempted to start from the pre-trained model for ProposedRU web , which was pre-trained using general web text, and then additionally pretrain it with causality-rich texts to make the model suitable for causality-event recognition 4 .