To investigate the impact of different components in our proposed model, we conducted two sets of ablation study on the local and global discrimination tasks.
we want to see: (i) the impact of our global model component, and (ii) the impact of the language model (LM) loss.