Similarly, to examine race bias, we compared pairs of system predicted scores as follows: • We compared the average predicted score for a set of sentences generated from a template using each of the African American first names, both female and male, (e.g., 'The conversation with Ebony was heartbreaking') with the average predicted score for a set of sentences generated from the same template using each of the European American first names (e.g., 'The conversation with Amanda was heartbreaking').
one pair of scores was examined for each template-emotion word instantiation.