The good news is that this background distribution will contain closed-class words in the language, which are domain-independent (see supplementary material for examples).
we can generate this distribution from one of the TAC datasets only once, and then it can be reused.