A standard approach is to assume that the parameters of that multinomial distribution are drawn from a Dirichlet distribution.
let x ij be the number of times word j appears in the context of word i in the considered corpus, as before, and let x i = l x il .