For years, the summarization community has been actively seeking an automatic evaluation methodology that can be readily applied to various summarization tasks.
it is unknown how large a parallel corpus is sufficient in providing a paraphrase collection good enough to help the evaluation process.