We would like to score every path in the lattice with the NMT system and then search.
this is generally prohibitively expensive because the RNN architectures in NMT do not permit recombination of hypotheses on the lattice, since NMT states encode the entire sentence history.