The unobserved term can be either real zero (two words shouldn't be co-occurred even when we use very large corpus) or just missing in the small corpus.
in the experiments, we evaluate all models with u avg .