We can extract a set of top B(≥ N ) candidates using beam search with beam size B, namely in the descending order of likelihood.
in the case of deterministic segmentation, in the case of stochastic segmentation, same query q i , q j (i = j) with different token sequence t i , t j may exist.