Recent automatic evaluation metrics typically frame the evaluation problem as a comparison task: how similar is the machine-produced output to a set of human-produced reference translations for the same source text?
as the notion of similarity is itself underspecified, several different families of metrics have been developed.