It has been argued that pairwise evaluation is useful and sufficient for machine translation evaluation (Guzmán et al., 2015(Guzmán et al., , 2017.
duh (2008) has shown that ranking-based evaluation measures can achieve higher correlations with human judgments, as ranking judgments are easier to obtain from human judges and are also easy to use in training, while also directly achieving the purpose of comparing two systems.