While there are existing automated metrics for assessing translation quality (Papineni et al., 2002;Banerjee and Lavie, 2005;Snover et al., 2006), these must be modified to find the necessary compromise between translation quality and expeditiousness.
a good metric for simultaneous translation must achieve a balance between translating chunks early and translating accurately.