We have been involved in a number of task-based evaluations of NLG systems and components.
for Experiment 1, which focused on content-to-text, we asked three meteorologists 5 (who had not contributed to the original SUMTIME-METEO corpus) to rewrite the corpus texts for the 21 dates used in Experiment 1 (each meteorologist rewrote all 21 corpus texts), correcting and improving them as they saw fit; examples are shown in Table 1.