ROTOWIRE data it achieves over 90% accuracy on held-out data, and recalls approximately 60% of the relations licensed by the records.
with a sufficiently precise relation extraction system, we can begin to evaluate how well an automatic generationŷ 1:T has captured the information in a set of records s. since the predictions of a precise information extraction system serve to align entity-mention pairs in the text with database records, this alignment can be used both to evaluate a generation's content selection ("what the generation says"), as well as content placement ("how the generation says it").