Because the dataset is constructed based on Freebase, we preprocessed the data by mapping each entity to the corresponding entry in Wikipedia and excluded those entities that did not exist in Wikipedia.
we used the accuracy (an entity is correct if all its types and no incorrect types are assigned to it), microaverage F1 (F1 score of all type-entity assignment decisions), and macro-average F1 (F1 score of types assigned to an entity, averaged over entities).