On the one hand, although highly reliable, in addition to being expensive and time consuming, human evaluation suffers from inconsistency problems due to inter-and intraannotator agreement issues.
while being consistent, fast and cheap, automatic evaluation has the major disadvantage of requiring reference translations.