For a formally organized event, such as the annual MT Evaluation sponsored by National Institute of Standard and Technology (NIST MT Eval), it may be worthwhile to recruit multiple human translators to translate a few hundred sentences for evaluation references.
there are situations in which multiple human references are not practically available (e.g., the source may be of a large quantity, and no human translation exists).