Without the coarse pass, the dense marginal computation is not efficient on a GPU, processing only 32 sentences per second.
our approach allows us to process over 190 sentences per second, almost a 6x speedup.