First, we show that human evaluation alone is insufficient to discriminate model generations from the references, leading to inflated estimates of model performance.
hUSE is able to reveal deficiencies of current models.