At the end of annotating, the inter-annotator agreement was calculated by double-annotating the same five texts and measuring the F1 score.
to existing datasets built primarily on news (focused on geopolitical entities and organizations), literary texts offer strikingly different distributions of entity categories, with much stronger emphasis on people and description of settings.