For each sentence we selected the best and worst translations according to a human evaluation score based on the expected wins (Callison-Burch et al., 2012).
we had 60 references with two corresponding translations each, adding up to a total of 120 evaluation tasks.