Without any grounding on this assumption, Kempe [8] simply calculates the entropy of branching for a fixed length of 4-grams.
the length of n is set to 3, h(x i−3,i ) is calculated for all i, and the maximum values are claimed to indicate the word boundary.