When evaluating this new system, we will include similar measures to those described here to enable the evaluations of the two systems to be compared.
automated evaluation metrics that rate system behaviour based on automatically computable properties have been developed in a number of other fields: widely used measures include BLEU (Papineni et al., 2002) for machine translation and ROUGE (Lin, 2004) for summarisation, for example.