Traditionally, evaluation on SemEval is conducted without entity mentions masked.
as we will discuss in Section 6.4, this method encourages models to overfit to these mentions and fails to test their actual ability to generalize.