Moreover, the vast majority of these papers do not engage with the relevant literature outside of NLP to ground normative concerns when proposing quantitative techniques for measuring or mitigating "bias."
we fnd that many of these techniques are poorly matched to their motivations, and are not comparable to one another.