Instead, the word-breaker returns all possible words that span the given string in a word lattice, and the best word sequence is determined by applying the syntactic rules for building parse trees.
there is no task of selecting the best segmentation per se; the best word-breaking analysis is merely a concomitant of the best syntactic parse.