For the four categories with a reasonable IAA, Joy, Anger, Sadness and Fear, our best models, on average, actually outperform human agreement.
our data shows that automatically mapping between representation formats is feasible at a performance level on par with or even surpassing human annotation capability.