Pathological verbosity was reported when using MERT on recall-oriented metrics such as ME-TEOR (Lavie and Denkowski, 2009;Denkowski and Lavie, 2011), as well as large variance with MIRA (Simianer et al., 2012).
to this end, we have studied the impact that source-side length and verbosity of tuning sets have on the performance of the translation system when tuning the system with different optimizers such as MERt and PRO.