This gap is only marginally larger than the performance gap of 2.4% when evaluating the model on two randomly split groups.
if we evaluate the performance gap on the sentences containing the token "racist", the performance gap between these two groups is as large as 19%.