We conjecture this happens because the BERT language model was trained on a large text corpus that comes from these two do-  mains.
importantly, AutoROCC is more robust across domains that are different from these two, since it is an unsupervised approach that is not tuned for any specific domain.