For each set of classes, we consider a setting where directed relations are predicted with one where the direction is ignored.
in the directed prediction scenario, each emotion constitutes two classes to be predicted for both possible directions (therefore, 16, 10, and 4 labels exist).