This results in as many triplets (input, question, answer) as named entities present in the reference summary, where input denotes the summary to assess, question refers to the sentence containing the masked entity and answer refers to this masked entity to retrieve.
for each summary to assess, metrics can be derived from the ability of the QA system to retrieve the correct answers from each of the associated triplets.