There is increasing interest in techniques for evaluating Natural Language Generation (NLG) systems.
we are not aware of any previously reported evaluations of NLG systems which have rigorously compared the task effectiveness of an NLG system to a non-NLG alternative.