These results show that agreement coefficients should not be used as indicators of the suitability of annotated data for machine learning.
the purpose of reliability studies is not to find out whether annotations can be generalized, but whether they capture some kind of observable reality.