Before this field grows further, it is important that the community critically examines the current evaluation metrics being used for this task.
there is a need to closely examine the utility of existing n-gram based similarity metrics such as BLEU (Papineni et al., 2002), METEOR (Lavie and Denkowski, 2009), NIST (Doddington, 2002), etc.