Second, through an annotation study, we introduce a way of mitigating annotator bias through dialect and race priming.
by designing tasks that explicitly highlight the inferred dialect of a tweet or likely racial background of its author, we show that annotators are significantly less likely to label an AAE tweet as offensive than when not shown this information ( §4).