It is convenient for computer scientists to regard the labels as ground truth, the dataset as static and try different models to improve the f-score.
as domain experts gained a deeper understanding about the twitter users, they marked 12% of the aggression labels as controversial (section 3); the annotation may evolve over time.