Any reasonable MT system will nowadays generate texts where most words are correct, so the label distribution is very skewed towards the "OK" class.
we suggest instead the multiplication of F 1 -scores for individual classes: it is equal to zero if one of the components is zero, and since both are in the [0,1] range, the overall result will not exceed the value of any of the multipliers.