A main shortcoming of using ROUGE-1 is that the generated sentences are compared only to a finite set of human labeled ground truth which obviously does not capture all possible sentences that one can generate.
rOUGE-1 does not take into account the fact that sentence generation is innately a creative process, and a better recall metric will be to ask humans to judge these sentences.