We use a Bayesian framework for estimating P est (w|s a ).
we assume a beta prior (conjugate to the Bernoulli distribution) for each word: where µ is a smoothing parameter estimated on the development set, b w,s a is a Boolean variable denoting whether w appears in the annotation s a , and N w is the number of latent variables that contain w in their annotations.