Similarly, the model trained on the masked FEVER data and tested on FNC outperforms the lexicalized model by 4.7% FNC score.
our experiments demonstrate that our masking strategy is successful in mitigating the dependency on domain-specific lexical information.