Our higher-order skip-gram (HOSG) replaces this Gaussian with a multinomial.
hOSG attempts to maximize the log-likelihood Note that as before, we are taking the total count N jk = i X ijk to be observed.