Parallel approaches do exist (Snoek et al., 2012;González et al., 2015), but we find it easy enough to harness parallel computation in decoding tuning sets and by decoupling BLEU measurements from speed measurements.
the maximum number of hypotheses allowed to survive histogram pruning in each decoding stack.