To use maximum likelihood or minimum cross-entropy, it assumes that the model distribution is peaked.
we notice that, in ondevice model, user queries tend to be short, with on average 2.4 words in a query, shown in Table.