In a similar spirit to the results obtained in the comparison against the gold standard, modeling the ability of the annotators was also found to be essential for a good predictive performance (results presented   in Table 5).
in this type of evaluation, the unpooled models can overfit, affecting their performance (e.g., a model of higher complexity like D&S, on a small dataset like WSD).