The high correlations we obtain between the metrics indicate that this may be the case.
bLEU-1ref obtains correlations of 0.86 (p = 7 × 10 −3 ) without splits and of 0.52 (p = 0.04) where splitting is involved.