Further, we run additional experiments for MT systems that are known to have low correlation with automatic metrics calculated with standard references.
we investigated MT systems augmented with either back-translation or automatic post-editing (APE).