As described in detail in Section 2, past reevaluations of human parity claims were hampered by sub-optimal test settings.
they focus only on the effect of translationese with re-spect to human evaluation, without considering its differing effect on automatic evaluation.