A possible drawback of our approach is that it only relies on entities, which do not fully cover the sentence semantics.
finally, performing outlier-aware meta-evaluation which was recently shown to be important in such settings (Mathur et al., 2020) could be beneficial.