In this paper, we present an evaluation framework to analyze social bias in NRE models.
we evaluate gender bias in English language predictions of a collection of popularly used and open source NRE models 1 (Lin et al., 2016;Wu et al., 2017;Liu et al., 2017;Feng et al., 2018).