To take this into account, we also evaluate these measures over larger blocks (similar to Ayan and Dorr [2006]).
we extract phrase pairs from the alignments produced by our annotators using a modified version of the standard SMT phrase extraction heuristic (Och, Tillmann, and Ney 1999).