Innovations, on the other hand, are generated from a language model independent of the parent's word.
our generative process takes the following form: • For each gloss m, choose a root word W root ∼ λ, a language model over words.