Beyond unsupervised intrinsic experiments, we also evaluate the capability of the event temporal representation as a product of our model.
we finetune both BERT baseline and our model with the same process to compare the internal representations of the transformers.