In contrast, the macro average does not bias the scores, thus the roles having a small number of instances affect the average more than the micro average.
we thus propose another approach that incorporates group information as feature functions.